-- Logs begin at Thu 2021-09-23 02:22:42 UTC, end at Thu 2021-09-23 03:49:37 UTC. -- Sep 23 03:04:26.406806 dv-cinder-768458-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 03:04:26.414284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 23 03:04:26 2021] *** Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: nodename: dv-cinder-768458-9-iscsi Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: machine: x86_64 Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: clock source: unix Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: pcre jit disabled Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: detected number of CPU cores: 4 Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: current working directory: / Sep 23 03:04:26.416284 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: detected binary path: /usr/bin/uwsgi-core Sep 23 03:04:26.416979 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: your processes number limit is 47680 Sep 23 03:04:26.416979 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: your memory page size is 4096 bytes Sep 23 03:04:26.416979 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: detected max file descriptor number: 2048 Sep 23 03:04:26.416979 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: lock engine: pthread robust mutexes Sep 23 03:04:26.420522 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: thunder lock: enabled Sep 23 03:04:26.420522 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 03:04:26.420522 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 23 03:04:26.463447 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: Python main interpreter initialized at 0x55d59beb79c0 Sep 23 03:04:26.463447 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: python threads support enabled Sep 23 03:04:26.463447 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: your server socket listen backlog is limited to 100 connections Sep 23 03:04:26.463447 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: your mercy for graceful operations on workers is 90 seconds Sep 23 03:04:26.464587 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 03:04:26.464698 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: *** Operational MODE: preforking *** Sep 23 03:04:26.464993 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: *** uWSGI is running in multiple interpreter mode *** Sep 23 03:04:26.464993 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: spawned uWSGI master process (pid: 93999) Sep 23 03:04:26.465210 dv-cinder-768458-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 03:04:26.466415 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: spawned uWSGI worker 1 (pid: 94000, cores: 1) Sep 23 03:04:26.466415 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: spawned uWSGI worker 2 (pid: 94001, cores: 1) Sep 23 03:04:26.466415 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 03:04:28.121506 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:04:28.121506 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: from cryptography.utils import int_from_bytes Sep 23 03:04:28.122142 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:04:28.122142 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: from cryptography.utils import int_from_bytes Sep 23 03:04:28.137643 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:04:28.137643 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: from cryptography.utils import int_from_bytes Sep 23 03:04:28.138143 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:04:28.138143 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: from cryptography.utils import int_from_bytes Sep 23 03:04:30.818539 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:04:30.819050 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:04:30.819254 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:04:30.819613 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:04:30.819901 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:04:30.820712 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.820712 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.820892 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.821206 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.821463 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:04:30.821805 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.821895 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:04:30.821974 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.822137 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.822222 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:04:30.822452 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.822545 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:04:30.822774 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.822857 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:04:30.823034 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823171 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823345 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823503 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823672 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-9-iscsi {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823834 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.823988 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824152 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824292 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824509 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824610 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824830 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.824920 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825154 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825239 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825477 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825560 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825808 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.825894 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.826070 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.826304 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.826414 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827448 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-9-iscsi {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827579 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827699 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827787 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827866 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.827936 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828014 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828091 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828183 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828266 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828343 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828425 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828595 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.828723 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.829442 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.829655 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.829883 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.829966 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830195 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830293 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830557 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830639 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-9-iscsi {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830871 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.830967 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831191 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831287 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831503 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831594 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831813 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.831904 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.832216 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.832543 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.832864 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.833186 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.833510 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.833840 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.834182 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.834507 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.834602 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.834844 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.834951 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-9-iscsi {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.835170 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.835272 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.835529 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.835975 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.836301 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.836629 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.836945 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.837256 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.837592 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.838044 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.838394 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.838706 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839008 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839186 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839332 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839422 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839649 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839737 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.839908 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840009 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840225 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840324 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840577 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840668 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.840992 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.841305 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.841689 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.842026 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.842287 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.842545 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.842870 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.843196 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.843508 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.843819 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844037 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844134 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844422 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844525 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844767 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.844862 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845075 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845171 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845380 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845475 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845691 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.845785 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846008 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846104 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846323 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846410 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846642 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846728 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.846948 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.847265 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.847616 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.847707 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.847892 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.847981 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848158 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848254 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848513 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848614 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848844 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.848937 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849152 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849246 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849470 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849557 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849787 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.849875 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.850094 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.850182 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.850398 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.850492 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.850701 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851016 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851336 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851422 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851637 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851725 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851885 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.851981 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.852182 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.852313 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.852501 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.852729 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.852865 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853068 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853196 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853387 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853513 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853686 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853811 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.853983 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.854284 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.854585 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.854769 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.854895 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855044 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855179 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855374 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855507 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855732 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.855861 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856044 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856169 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856344 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856519 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856670 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856808 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.856986 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857121 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857303 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857430 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857607 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857733 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.857910 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858045 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858211 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858337 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858516 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858652 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858835 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.858963 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859086 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859207 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859395 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859521 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859705 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.859833 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860052 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860176 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860358 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860518 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860695 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860828 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.860999 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861132 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861301 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861439 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861614 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861741 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.861909 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862042 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862213 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862348 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862520 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862652 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862821 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.862953 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863124 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863259 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863426 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863553 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863728 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.863854 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864030 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864168 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864331 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864459 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864656 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864794 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.864958 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865093 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865257 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865385 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865570 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865694 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.865882 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866010 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866185 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866311 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866489 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866616 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866793 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.866929 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.867109 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.867237 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.867417 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.867543 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.867726 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.867854 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.868051 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.868177 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.868364 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.868520 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.868727 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.868854 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.869011 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.869138 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.869318 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.869452 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.869628 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.869754 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.869940 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.870066 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.870248 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.870372 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.870558 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.870684 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.870863 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.870989 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.871168 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.871305 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.871473 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.871592 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.871781 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.871907 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.872087 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.872222 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.872395 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.872567 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.872721 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.872846 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.873028 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.873170 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.873336 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.873462 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.873646 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.873770 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.873956 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.874092 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.874266 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.874392 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.874574 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.874710 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:04:30.874911 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.875038 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.875242 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.875367 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.876353 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.876515 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.876708 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.876863 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877044 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877181 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877383 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877511 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877708 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.877837 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878026 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878154 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878345 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878479 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878675 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878804 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.878993 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879121 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879308 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879435 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879624 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879752 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.879942 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880073 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880262 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880390 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880602 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880738 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.880920 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881050 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881236 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881364 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881555 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881682 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881863 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.881990 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882179 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882318 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882510 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882646 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882821 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.882954 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883142 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883277 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883462 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883589 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883780 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.883908 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884099 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884243 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884411 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884556 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884753 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.884882 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885072 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885210 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885384 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885517 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885702 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.885835 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886020 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886149 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886328 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886453 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886648 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886782 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.886956 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887082 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887266 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887399 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887585 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887713 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.887898 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888026 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888208 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888334 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888539 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888663 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888856 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.888983 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.889174 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.889484 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.889602 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.889808 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.890909 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.891039 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.891791 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.891924 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892141 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892279 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892457 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892627 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892802 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.892934 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893120 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893256 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893435 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893563 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893750 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.893876 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894067 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894271 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894398 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894511 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894672 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894800 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.894983 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895119 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895294 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895419 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895602 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895728 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.895912 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896041 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896220 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896352 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896551 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896697 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896865 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.896994 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897178 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897309 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897493 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897613 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897800 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.897925 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898107 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898233 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898416 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898543 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898751 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.898879 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899059 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899184 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899383 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899509 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899714 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.899843 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900043 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900170 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900364 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900555 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900682 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.900806 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901008 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901136 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901317 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901456 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901624 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901752 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.901930 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902057 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902242 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902382 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902551 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902682 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902860 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.902994 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903169 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903306 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903477 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903611 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903785 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.903912 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904103 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904238 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904414 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904567 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904748 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.904875 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905055 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905184 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905389 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905521 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905702 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.905838 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906010 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906140 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906343 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906468 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906659 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906822 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.906961 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907086 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907278 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907406 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907593 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907713 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.907907 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908094 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908244 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908369 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908548 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908689 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908864 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.908997 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909177 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909310 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909527 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909667 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909792 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.909921 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910107 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910234 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910423 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910559 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910727 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.910852 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911045 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911179 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911367 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911533 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911659 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911789 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.911983 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912102 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912297 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912433 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912643 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912772 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.912958 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913096 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913272 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913400 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913585 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913713 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.913890 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914021 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914197 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914339 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914511 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914642 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914825 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.914951 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915135 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915261 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915447 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915575 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915753 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.915890 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916069 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916197 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916379 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916541 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916710 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.916846 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917019 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917147 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917331 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917458 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917637 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917772 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.917955 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918080 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918277 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918404 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918599 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918739 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.918905 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919032 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919210 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919337 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919530 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919664 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919840 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.919966 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920144 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920264 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920449 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920676 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920804 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.920927 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921107 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921241 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921420 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921557 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921726 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.921854 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922044 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922171 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922370 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922501 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922666 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922793 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.922980 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923107 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923309 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923436 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923589 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923718 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.923894 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924021 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924209 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924337 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924540 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924670 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924854 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.924982 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925165 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925298 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925475 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925603 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925782 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.925916 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926092 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926219 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926407 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926532 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926717 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.926852 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927022 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927148 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927324 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927450 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927630 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927764 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.927946 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.928072 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.928274 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.928539 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.928669 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.928877 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929013 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929195 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929322 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929516 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929643 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929835 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.929961 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930152 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930281 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930465 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930601 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930794 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.930925 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931110 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931238 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931419 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931560 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931729 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.931857 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932035 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932162 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932343 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932478 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932672 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932805 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.932971 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933098 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933277 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933415 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933581 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933709 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.933890 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934024 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934193 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934326 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934499 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934627 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934814 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.934944 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.935116 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.935386 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.935527 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.935721 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.935847 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936032 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936167 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936343 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936472 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936693 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.936819 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937004 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937130 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937309 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937444 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937613 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937741 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.937918 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.938554 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.938761 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.938897 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939070 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939197 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939387 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939512 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939698 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.939826 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940016 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940151 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940327 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940456 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940667 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940795 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.940976 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941113 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941292 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941426 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941596 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941722 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.941901 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942028 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942216 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942352 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942523 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942662 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942824 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.942951 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943134 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943259 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943444 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943570 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943750 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.943876 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944057 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944190 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944362 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944512 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944698 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.944824 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945003 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945136 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945308 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945435 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945615 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945741 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.945919 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946047 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946229 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946364 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946539 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946667 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946848 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.946985 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947152 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947286 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947461 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947589 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947767 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.947975 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948103 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948231 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948376 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948534 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948705 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.948846 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949013 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949142 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949325 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949452 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949633 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949769 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.949938 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950067 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950250 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950377 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950562 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950688 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950869 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.950995 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951172 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951299 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951476 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951602 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951780 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.951913 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952089 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952215 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952399 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952548 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952732 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.952860 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.953039 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.953157 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.953351 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.953480 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.953655 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.954279 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.954519 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.954645 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.954825 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.954951 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955129 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955261 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955433 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955571 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955738 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.955872 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956043 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956170 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956350 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956570 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956698 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956830 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.956991 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957119 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957296 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957430 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957598 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957723 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.957902 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958030 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958206 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958341 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958516 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958642 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958825 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.958952 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959134 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959270 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959447 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959575 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959772 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.959899 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960094 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960223 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960405 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960562 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960743 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.960871 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961048 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961175 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961352 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961478 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961659 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961792 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.961969 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962095 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962273 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962406 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962577 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962703 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.962880 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963007 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963186 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963313 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963495 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963621 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963806 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.963939 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964116 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964242 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964422 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964583 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964759 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.964895 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965067 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965186 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965376 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965510 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965693 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.965842 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966005 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966133 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966323 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966459 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966636 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966770 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.966948 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967075 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967259 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967396 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967567 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967693 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.967879 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968010 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968183 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968310 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968538 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968669 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968815 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.968943 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969126 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969281 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969456 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969583 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969766 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.969915 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970078 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970211 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970384 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970512 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970695 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.970824 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971002 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971131 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971311 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971445 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971616 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971744 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.971935 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972072 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972249 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972387 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972588 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972720 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.972904 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973031 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973222 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973358 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973537 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973674 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.973854 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974006 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974169 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974303 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974478 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974615 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974790 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.974917 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975105 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975239 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975415 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975552 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975730 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.975858 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976044 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976174 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976353 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976483 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976708 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.976847 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977023 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977151 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977350 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977475 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977622 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977750 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.977929 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978063 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978243 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978372 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978549 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978675 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.978872 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979001 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979278 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979404 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979592 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979720 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.979898 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980028 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980211 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980339 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980545 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980678 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.980869 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981009 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981186 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981314 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981494 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981623 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.981884 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982018 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982193 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982320 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982510 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982645 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982822 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.982960 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983133 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983261 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983442 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983563 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983757 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.983898 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984070 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984202 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984379 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984533 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984714 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.984843 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985032 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985160 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985367 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985495 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985680 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.985810 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986006 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986134 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986433 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986562 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986755 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.986885 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987069 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987196 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987391 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987517 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987703 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.987831 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988011 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988138 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988324 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988460 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988656 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988784 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.988965 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989093 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989290 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989430 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989601 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989729 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.989917 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990045 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990230 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990385 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990541 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990678 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990848 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.990983 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991155 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991283 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991479 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991615 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991786 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.991914 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992110 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992246 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992424 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992616 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992773 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.992894 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993097 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993233 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993403 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993540 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993727 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.993863 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994040 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994176 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994347 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994476 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994653 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994781 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.994956 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995085 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995298 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995427 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995604 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995732 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.995911 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996046 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996238 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996367 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996573 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996703 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.996890 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997017 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997202 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997332 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997517 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997656 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997826 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.997955 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998136 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998271 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998457 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998586 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998754 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.998891 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999060 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999188 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999373 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999502 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999681 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999818 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:30.999986 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.000114 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.000291 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.000420 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.001414 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.001560 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.001726 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.001855 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002032 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002159 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002335 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002474 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002641 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002768 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.002957 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003083 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003282 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003415 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003594 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003721 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.003902 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004030 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004210 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004339 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004534 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004668 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.004877 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005007 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005185 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005315 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005520 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005651 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005840 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.005966 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006162 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006290 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006470 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006597 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006783 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.006912 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007101 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007236 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007411 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007538 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007721 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.007861 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008029 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008176 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008337 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008472 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008663 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008797 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.008974 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009102 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009281 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009416 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009588 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009716 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.009907 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010034 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010224 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010349 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010534 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010674 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.010842 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011052 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011188 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011384 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011550 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011701 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.011830 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012020 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012156 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012337 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012474 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012679 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012807 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.012996 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013117 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013313 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013455 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013627 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013756 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.013939 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014067 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014254 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014391 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014569 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014695 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.014887 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015015 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015206 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015334 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015525 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015652 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015842 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.015970 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.016180 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.016314 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.016556 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.016686 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.016879 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017007 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017198 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017328 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017517 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017652 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.017837 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018039 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018176 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018372 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018508 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018692 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.018820 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019009 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019138 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019325 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019454 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019648 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019777 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.019959 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020087 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020272 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020402 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020605 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020748 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.020920 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021048 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021232 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021358 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021557 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021697 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.021879 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022006 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022200 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022326 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022516 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022653 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022832 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.022960 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023150 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023276 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023470 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023670 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023799 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.023988 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.024116 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.024324 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.024460 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.024677 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.024817 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025004 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025140 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025324 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025529 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025658 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025782 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.025961 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026096 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026273 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026401 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026579 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026707 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.026893 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027020 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027202 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027330 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027511 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027639 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027822 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.027956 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028132 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028259 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028437 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028587 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028782 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.028910 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029092 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029222 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029413 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029631 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029760 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.029983 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.030112 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.030306 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.030544 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.030671 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.030866 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.031008 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.031206 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.031335 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.031536 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.031673 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.032382 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.032556 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.032720 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.032847 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033033 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033161 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033356 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033556 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033683 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033805 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.033962 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034089 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034268 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034402 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034581 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034708 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.034890 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035016 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035197 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035326 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035511 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035638 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035815 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.035934 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.036135 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.036270 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.036447 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.036598 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.036781 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037008 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037147 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037353 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037483 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037672 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037800 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.037983 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038117 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038294 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038423 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038602 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038730 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.038913 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039041 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039218 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039345 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039532 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039661 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039840 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.039975 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040151 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040278 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040459 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040644 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040782 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.040913 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041084 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041212 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041398 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041739 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041739 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.041961 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042088 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042219 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042345 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042478 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042604 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042727 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.042908 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043037 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043217 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043357 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043525 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043661 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043835 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.043964 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.044152 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.044290 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.044461 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.044716 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.044848 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045052 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045180 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045384 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045512 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045703 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.045832 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046012 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046153 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046326 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046455 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046636 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046771 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.046941 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047077 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047247 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047410 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047616 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047746 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.047928 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048066 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048238 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048365 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048636 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048769 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.048949 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049086 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049259 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049386 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049571 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049699 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.049897 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050071 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050208 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050389 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050518 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050735 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.050880 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.051060 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.051188 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.051381 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.051679 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.051807 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052009 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052144 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052324 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052453 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052664 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052793 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.052980 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053111 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053295 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053430 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053616 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053745 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.053930 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054059 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054252 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054379 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054561 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054701 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.054874 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055002 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055187 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055326 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055503 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055645 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055816 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.055952 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056130 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056259 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056443 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056609 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056856 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.056996 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057170 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057291 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057494 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057625 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057810 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.057938 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058140 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058270 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058485 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058614 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058817 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.058944 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059137 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059259 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059446 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059582 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059757 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.059884 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060064 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060192 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060379 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060545 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060734 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.060864 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061055 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061196 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061367 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061496 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061683 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.061811 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062010 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062147 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062325 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062461 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062650 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062778 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.062997 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063210 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063346 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063473 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063623 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063751 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.063958 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064088 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064273 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064403 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064609 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064739 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.064924 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065054 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065238 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065366 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065551 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065679 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065862 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.065991 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066192 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066320 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066502 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066637 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066813 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.066942 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067128 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067256 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067448 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067584 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067770 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.067896 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068086 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068220 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068398 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068620 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068758 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.068883 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069059 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069186 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069374 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069511 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069687 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069816 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.069999 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070128 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070312 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070439 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070626 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070754 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.070950 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071076 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071264 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071393 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071580 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071708 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.071894 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072022 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072206 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072336 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072545 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072677 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.072878 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.073006 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.073204 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.073332 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.073457 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:04:31.073581 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.073824 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.074145 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.074467 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.074784 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.075097 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.075428 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.075743 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.076061 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.076374 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.076712 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.077032 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.077352 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.077682 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.078013 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.078342 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.079198 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.079546 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.079872 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.080207 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.080566 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:04:31.080814 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:04:31.096348 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_db.sqlalchemy.engines [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.102791 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.273031 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.context [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2e928b7-7406-4a56-84c2-2a89dd3469c1(cell1) {{(pid=94001) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:04:31.277369 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_concurrency.lockutils [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:04:31.278929 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_concurrency.lockutils [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:04:31.279743 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_concurrency.lockutils [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:04:31.279914 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.context [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2e928b7-7406-4a56-84c2-2a89dd3469c1(cell1) {{(pid=94000) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:04:31.281674 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_concurrency.lockutils [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:04:31.284286 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:04:31.285905 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:04:31.286737 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:04:31.288696 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:04:31.292208 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_db.sqlalchemy.engines [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.294291 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_db.sqlalchemy.engines [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.303594 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.305907 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.552561 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG oslo_db.sqlalchemy.engines [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.567035 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:04:31.972090 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: WARNING keystonemiddleware.auth_token [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:04:31.978544 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: WARNING keystonemiddleware.auth_token [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:04:31.997191 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: WARNING keystonemiddleware.auth_token [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:04:32.007405 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: WARNING keystonemiddleware.auth_token [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:04:32.319493 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: WARNING keystonemiddleware.auth_token [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:04:32.324632 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: WARNING keystonemiddleware.auth_token [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:04:32.330782 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d59beb79c0 pid: 94001 (default app) Sep 23 03:04:32.332841 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:04:32.334136 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Sep 23 03:04:32.334545 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 789 bytes} [Thu Sep 23 03:04:32 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:04:32.364277 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: WARNING keystonemiddleware.auth_token [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:04:32.369473 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: WARNING keystonemiddleware.auth_token [None req-b7ea0470-af22-4764-bf79-ab6f52ccb771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:04:32.375651 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d59beb79c0 pid: 94000 (default app) Sep 23 03:05:55.050383 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:05:55.051371 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Sep 23 03:05:55.051759 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:05:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:05:55.487128 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-960b0998-9ba5-415a-96c0-0dac25a08e71 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:05:55.517811 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-960b0998-9ba5-415a-96c0-0dac25a08e71 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458497 Sep 23 03:05:55.518471 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Sep 23 03:05:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:05:57.794025 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:05:57.795008 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-91bca0c2-c88f-4817-8cdc-77de9714ea2c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 23 03:05:57.795406 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:05:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:05:57.859156 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-1117982c-8243-4f4a-a925-9d2c20455e0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:05:57.878409 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:05:57.878409 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:05:57.970427 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-1117982c-8243-4f4a-a925-9d2c20455e0a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168699 Sep 23 03:05:57.971222 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:05:57 2021] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:05:58.201306 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-592663ad-18c0-42be-b869-f68dd420c91b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:05:58.203840 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:05:58.203840 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: warnings.warn(msg) Sep 23 03:05:58.349122 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-592663ad-18c0-42be-b869-f68dd420c91b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369509 Sep 23 03:05:58.351945 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Sep 23 03:05:57 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:06:00.554745 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-1117982c-8243-4f4a-a925-9d2c20455e0a admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:00.555800 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-1117982c-8243-4f4a-a925-9d2c20455e0a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 23 03:06:00.556205 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:00.681930 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-ec70de33-a7cc-47ec-8c56-439cd724a2d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:00.700229 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:06:00.700229 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: warnings.warn(msg) Sep 23 03:06:00.821525 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-ec70de33-a7cc-47ec-8c56-439cd724a2d7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.258827 Sep 23 03:06:00.829743 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:06:00.835777 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-f16a6c74-3881-42c6-918d-31e6d285ce72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:00.837303 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:06:00.837303 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:06:00.946444 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-f16a6c74-3881-42c6-918d-31e6d285ce72 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114439 Sep 23 03:06:00.947247 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Sep 23 03:06:00 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:03.160830 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-ec70de33-a7cc-47ec-8c56-439cd724a2d7 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:03.161829 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-ec70de33-a7cc-47ec-8c56-439cd724a2d7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 23 03:06:03.162241 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:03.223372 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-37cd2c51-1dfb-4ed0-8bfd-748d36b570f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:03.320238 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-37cd2c51-1dfb-4ed0-8bfd-748d36b570f9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150032 Sep 23 03:06:03.322747 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:06:03.333195 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f5288e79-9770-486a-8dcd-d88c0769516a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:03.443435 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f5288e79-9770-486a-8dcd-d88c0769516a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113631 Sep 23 03:06:03.444013 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Sep 23 03:06:03 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:05.730436 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-37cd2c51-1dfb-4ed0-8bfd-748d36b570f9 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:05.731408 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-37cd2c51-1dfb-4ed0-8bfd-748d36b570f9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 23 03:06:05.731807 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:05.791199 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-57edb8e2-bc68-4973-b343-40a8675c1940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:05.874100 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-57edb8e2-bc68-4973-b343-40a8675c1940 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135320 Sep 23 03:06:05.874862 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:06:05.886694 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-dea600a4-b116-41fc-ab81-87704fc9c28e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:05.968454 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-dea600a4-b116-41fc-ab81-87704fc9c28e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085259 Sep 23 03:06:05.969075 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Sep 23 03:06:05 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:08.226080 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-57edb8e2-bc68-4973-b343-40a8675c1940 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:08.227085 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-57edb8e2-bc68-4973-b343-40a8675c1940 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 23 03:06:08.227477 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:06:08.297425 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:08.398673 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164903 Sep 23 03:06:08.399228 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:06:08.411877 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-35f8a066-3f63-4003-b073-6bd32ecb9efe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:08.648165 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-35f8a066-3f63-4003-b073-6bd32ecb9efe admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.239700 Sep 23 03:06:08.648864 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Sep 23 03:06:08 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:10.869217 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:10.870278 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 23 03:06:10.870632 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:10.940021 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-86178177-d8de-4299-906a-819861c893f8 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:10.966755 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-86178177-d8de-4299-906a-819861c893f8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088381 Sep 23 03:06:10.967606 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Sep 23 03:06:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:06:13.441567 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:13.442592 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-66e813b4-97f5-47e0-984c-8c7661b3dab1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 23 03:06:13.443004 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:13.508792 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-e61d6d44-b33a-4901-979f-5b4d71cdabf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 512, "name": "m1.tiny"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:13.594341 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-e61d6d44-b33a-4901-979f-5b4d71cdabf3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142977 Sep 23 03:06:13.594899 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:13 2021] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:06:13.617258 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-e7ab49f6-8cbb-4681-a819-a555b7e6a51e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:13.740347 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-e7ab49f6-8cbb-4681-a819-a555b7e6a51e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126848 Sep 23 03:06:13.740964 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Sep 23 03:06:13 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:16.768614 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-e61d6d44-b33a-4901-979f-5b4d71cdabf3 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:16.769613 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-e61d6d44-b33a-4901-979f-5b4d71cdabf3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001680 Sep 23 03:06:16.770005 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:16.830263 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-b965f75d-6a39-494e-9459-2cb6727c5702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "swap": 0, "id": "2"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:16.930665 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-b965f75d-6a39-494e-9459-2cb6727c5702 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.154212 Sep 23 03:06:16.931219 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:16 2021] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:06:16.944162 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-60bd19da-4b5f-42e5-8b7f-9bff6ee72431 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:17.065330 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-60bd19da-4b5f-42e5-8b7f-9bff6ee72431 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124900 Sep 23 03:06:17.065932 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Sep 23 03:06:16 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:19.279874 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-b965f75d-6a39-494e-9459-2cb6727c5702 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:19.280920 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-b965f75d-6a39-494e-9459-2cb6727c5702 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 23 03:06:19.281359 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:19.339248 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-3015e827-c85e-4aa9-a435-fe942d28b29c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:19.416311 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-3015e827-c85e-4aa9-a435-fe942d28b29c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128380 Sep 23 03:06:19.416937 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:19 2021] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:06:19.429238 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-e8ae5630-f199-4b95-806b-de440a6f29f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:19.659833 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-e8ae5630-f199-4b95-806b-de440a6f29f0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.234228 Sep 23 03:06:19.660530 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Sep 23 03:06:19 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:06:21.898016 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-3015e827-c85e-4aa9-a435-fe942d28b29c admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:21.899741 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-3015e827-c85e-4aa9-a435-fe942d28b29c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002460 Sep 23 03:06:21.900215 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:21.994986 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-68d32fa3-8a78-4507-a596-d16e67ae7553 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "swap": 0}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:22.451268 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-68d32fa3-8a78-4507-a596-d16e67ae7553 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.543057 Sep 23 03:06:22.455100 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:06:22.469157 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-6069ce34-940d-48e2-af0b-fbd1ee623576 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:22.586216 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-6069ce34-940d-48e2-af0b-fbd1ee623576 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120552 Sep 23 03:06:22.587285 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Sep 23 03:06:22 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:06:24.823605 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-68d32fa3-8a78-4507-a596-d16e67ae7553 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:06:24.825184 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-68d32fa3-8a78-4507-a596-d16e67ae7553 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Sep 23 03:06:24.826058 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:06:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:06:24.889199 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:25.003325 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.171045 Sep 23 03:06:25.006301 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Sep 23 03:06:24 2021] POST /compute/v2.1/flavors => generated 408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:06:25.018831 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-8439b35d-38e7-46f5-95fa-1964b192dc34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:06:25.103441 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-8439b35d-38e7-46f5-95fa-1964b192dc34 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088276 Sep 23 03:06:25.106328 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Sep 23 03:06:25 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:07:03.549381 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:03.550383 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 23 03:07:03.550785 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:07:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:03.608161 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-e431be45-02f8-4459-99c4-0d375641536d admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:03.624825 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-e431be45-02f8-4459-99c4-0d375641536d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067684 Sep 23 03:07:03.625338 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Sep 23 03:07:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:07:05.042917 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:05.043901 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4ec9291c-16e4-45ad-8cd8-3e58e358d91e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Sep 23 03:07:05.044292 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:05.230385 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-8480c7ca-555e-41df-8c0b-e607e5d9f9be admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:05.235732 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.wsgi [None req-8480c7ca-555e-41df-8c0b-e607e5d9f9be admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 03:07:05.236290 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-8480c7ca-555e-41df-8c0b-e607e5d9f9be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:05.237105 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-8480c7ca-555e-41df-8c0b-e607e5d9f9be admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057811 Sep 23 03:07:05.237599 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Sep 23 03:07:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:05.248100 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-7c2340b7-1d15-421c-a8ea-e74ef6115f27 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:05.269195 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-7c2340b7-1d15-421c-a8ea-e74ef6115f27 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025564 Sep 23 03:07:05.269783 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:07:05.279616 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-ccc39b15-c60a-4c55-80cd-84e7b152f55f admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:05.300129 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-ccc39b15-c60a-4c55-80cd-84e7b152f55f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023913 Sep 23 03:07:05.300666 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:07:05.310781 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-bf306789-93ea-46f4-bb3d-910a470ef047 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:05.316147 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.wsgi [None req-bf306789-93ea-46f4-bb3d-910a470ef047 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 03:07:05.316770 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-bf306789-93ea-46f4-bb3d-910a470ef047 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:05.317551 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-bf306789-93ea-46f4-bb3d-910a470ef047 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010388 Sep 23 03:07:05.318029 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Sep 23 03:07:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:06.646632 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-ccc39b15-c60a-4c55-80cd-84e7b152f55f admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:06.647787 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-ccc39b15-c60a-4c55-80cd-84e7b152f55f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 23 03:07:06.648175 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:06.839395 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-cf9625e3-5862-42aa-af81-2d6bc641d666 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:06.844998 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.wsgi [None req-cf9625e3-5862-42aa-af81-2d6bc641d666 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 03:07:06.845565 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-cf9625e3-5862-42aa-af81-2d6bc641d666 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:06.846347 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-cf9625e3-5862-42aa-af81-2d6bc641d666 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058992 Sep 23 03:07:06.846844 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Sep 23 03:07:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:06.857335 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-03271ae4-5bff-47b2-aa27-f8660aeecfed admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:06.873609 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-03271ae4-5bff-47b2-aa27-f8660aeecfed admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020571 Sep 23 03:07:06.874138 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:07:06.884119 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4b7db141-73d6-45ab-b104-de05a6a06d47 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:06.898673 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4b7db141-73d6-45ab-b104-de05a6a06d47 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017985 Sep 23 03:07:06.899172 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:07:06.909681 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-e778f70d-a9e0-4529-9b22-d96f4d32a1ed admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:06.914836 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.wsgi [None req-e778f70d-a9e0-4529-9b22-d96f4d32a1ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 03:07:06.915398 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-e778f70d-a9e0-4529-9b22-d96f4d32a1ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:06.916816 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-e778f70d-a9e0-4529-9b22-d96f4d32a1ed admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010520 Sep 23 03:07:06.917305 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Sep 23 03:07:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:08.267478 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4b7db141-73d6-45ab-b104-de05a6a06d47 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:08.268471 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4b7db141-73d6-45ab-b104-de05a6a06d47 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Sep 23 03:07:08.268887 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:08.457000 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-7b156625-1bf1-49f3-9559-331e9ec78a60 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:08.462596 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.wsgi [None req-7b156625-1bf1-49f3-9559-331e9ec78a60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 03:07:08.463221 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-7b156625-1bf1-49f3-9559-331e9ec78a60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:08.463996 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-7b156625-1bf1-49f3-9559-331e9ec78a60 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058495 Sep 23 03:07:08.464482 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:07:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:08.474173 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-4a249f26-2609-440e-9da0-65badfa36874 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:08.487548 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-4a249f26-2609-440e-9da0-65badfa36874 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016955 Sep 23 03:07:08.488096 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:07:08.499193 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:08.513918 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018450 Sep 23 03:07:08.514478 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Sep 23 03:07:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:07:08.524598 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-ada5879f-c8f6-4255-9441-bcdc372c513a admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:08.530180 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.wsgi [None req-ada5879f-c8f6-4255-9441-bcdc372c513a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 03:07:08.530738 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-ada5879f-c8f6-4255-9441-bcdc372c513a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:07:08.531528 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-ada5879f-c8f6-4255-9441-bcdc372c513a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010525 Sep 23 03:07:08.532011 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:07:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 03:07:09.878744 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:09.879759 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 23 03:07:09.880157 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:10.077557 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-6654d430-d69f-409a-b84f-daa9ff4b005b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:07:10.157124 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-6654d430-d69f-409a-b84f-daa9ff4b005b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.130904 Sep 23 03:07:10.157647 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1236 bytes} [Thu Sep 23 03:07:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:07:11.529658 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:11.530654 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 23 03:07:11.531046 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:11.722138 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-66d17538-377b-45d4-84c8-15c779130b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:07:11.818302 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-66d17538-377b-45d4-84c8-15c779130b1d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.147383 Sep 23 03:07:11.818849 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1236 bytes} [Thu Sep 23 03:07:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:07:13.179412 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:13.180409 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 23 03:07:13.180897 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:13.368915 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-a418c8c8-4c4f-4cf9-ab26-497da1f09c51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:07:13.499014 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-a418c8c8-4c4f-4cf9-ab26-497da1f09c51 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.180918 Sep 23 03:07:13.499479 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1236 bytes} [Thu Sep 23 03:07:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:07:14.888874 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:14.889910 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 23 03:07:14.890468 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:15.081864 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-1ec967cd-5ee2-412a-a15b-c1671c723ad4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:07:15.193608 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-1ec967cd-5ee2-412a-a15b-c1671c723ad4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.163176 Sep 23 03:07:15.194149 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1236 bytes} [Thu Sep 23 03:07:15 2021] POST /compute/v2.1/flavors => generated 409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:07:16.542075 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:16.543070 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 23 03:07:16.543466 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:07:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:07:16.731259 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-419193bb-d955-4e0c-8886-60c497203b2d admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:07:16.751054 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-419193bb-d955-4e0c-8886-60c497203b2d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071363 Sep 23 03:07:16.751640 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1203 bytes} [Thu Sep 23 03:07:16 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:08:01.925664 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:01.926687 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3fb1da34-1bb3-4bb7-9ad3-54abc1506b82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 23 03:08:01.927075 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Thu Sep 23 03:08:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:08:01.984504 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-d7b85844-b2ac-49ca-adc0-b2c49d61ea32 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:02.003596 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-d7b85844-b2ac-49ca-adc0-b2c49d61ea32 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070070 Sep 23 03:08:02.004134 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Sep 23 03:08:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:08:02.027274 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-13f94200-3e47-4220-813e-a37b3c30e5de admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:02.034853 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-13f94200-3e47-4220-813e-a37b3c30e5de admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011146 Sep 23 03:08:02.047391 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Sep 23 03:08:02 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:08:02.047533 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-c79ba22d-9a9b-4193-b336-cd4904087171 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:02.054544 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-c79ba22d-9a9b-4193-b336-cd4904087171 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011052 Sep 23 03:08:02.055050 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Sep 23 03:08:02 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:08:02.066635 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-4df7471f-1dab-447e-b429-5e88e54b47d4 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:02.074644 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-4df7471f-1dab-447e-b429-5e88e54b47d4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011407 Sep 23 03:08:02.075085 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Sep 23 03:08:02 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:08:02.087106 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:08:02.094558 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Sep 23 03:08:02.095056 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Sep 23 03:08:02 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:09:31.759599 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-7b821aa0-44ea-4f29-8917-a386378d7741 tempest-verify_tempest_config-1586647696 tempest-verify_tempest_config-1586647696-project] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:09:31.761563 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-7b821aa0-44ea-4f29-8917-a386378d7741 tempest-verify_tempest_config-1586647696 tempest-verify_tempest_config-1586647696-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106831 Sep 23 03:09:31.762098 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Sep 23 03:09:31 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:10:58.587868 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:10:58.587868 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 23 03:10:58.587868 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:10:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:10:58.848845 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:10:58.849989 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:10:58.849989 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:10:58.851497 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:10:58.851935 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:10:58.852759 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:10:58.853183 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:10:58.886509 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-dd2c188f-99d4-4c78-a63e-fed4f85fbb61 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155728 Sep 23 03:10:58.887244 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:10:58 2021] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:11:00.303593 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:00.304730 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Sep 23 03:11:00.305119 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:11:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:11:00.497114 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:00.498257 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:11:00.498257 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:11:00.499763 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:00.500196 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:00.501028 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:00.501448 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:00.520215 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-90cb5dab-2d8c-4142-84ed-0e95a446e401 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074282 Sep 23 03:11:00.520713 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:11:00 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:11:12.289780 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:12.290770 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 23 03:11:12.291174 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:11:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:11:12.481775 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:12.482927 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:11:12.482927 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:11:12.484578 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:12.485020 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:12.485796 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:12.486218 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:12.510568 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-a5772a45-1ab6-4681-b4cc-56ae377942a0 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079933 Sep 23 03:11:12.511043 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 37/75] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:11:12 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:11:13.871354 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: DEBUG nova.api.openstack.wsgi [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] Calling method '>' {{(pid=94001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:13.872363 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: INFO nova.api.openstack.requestlog [None req-f7f11156-01a1-4c7d-87ae-bc687c5fd516 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 23 03:11:13.872796 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: [pid: 94001|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1075 bytes} [Thu Sep 23 03:11:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:11:14.066498 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG nova.api.openstack.wsgi [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] Calling method '>' {{(pid=94000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:11:14.067660 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:11:14.067660 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: warnings.warn(msg) Sep 23 03:11:14.069195 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:14.069631 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:14.070449 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:11:14.070846 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: DEBUG oslo_concurrency.lockutils [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:11:14.091149 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: INFO nova.api.openstack.requestlog [None req-3c1631ec-2094-4b18-ade3-1383813948df admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076250 Sep 23 03:11:14.091673 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: [pid: 94000|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Sep 23 03:11:14 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:12:11.958162 dv-cinder-768458-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 03:12:11.959008 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: Thu Sep 23 03:12:11 2021 - graceful shutdown triggered... Sep 23 03:12:11.959499 dv-cinder-768458-9-iscsi devstack@n-api.service[94001]: Gracefully killing worker 2 (pid: 94001)... Sep 23 03:12:11.959868 dv-cinder-768458-9-iscsi devstack@n-api.service[94000]: Gracefully killing worker 1 (pid: 94000)... Sep 23 03:12:12.960145 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: worker 1 buried after 1 seconds Sep 23 03:12:12.960617 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: worker 2 buried after 1 seconds Sep 23 03:12:12.960617 dv-cinder-768458-9-iscsi devstack@n-api.service[93999]: goodbye to uWSGI. Sep 23 03:12:12.961800 dv-cinder-768458-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 23 03:12:12.962339 dv-cinder-768458-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 03:12:12.965149 dv-cinder-768458-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 03:12:12.974388 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 23 03:12:12 2021] *** Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: nodename: dv-cinder-768458-9-iscsi Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: machine: x86_64 Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: clock source: unix Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: pcre jit disabled Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: detected number of CPU cores: 4 Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: current working directory: / Sep 23 03:12:12.976340 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: detected binary path: /usr/bin/uwsgi-core Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: your processes number limit is 47680 Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: your memory page size is 4096 bytes Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: detected max file descriptor number: 2048 Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: lock engine: pthread robust mutexes Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: thunder lock: enabled Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 03:12:12.977041 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 23 03:12:13.022733 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: Python main interpreter initialized at 0x55ae7507a9c0 Sep 23 03:12:13.022733 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: python threads support enabled Sep 23 03:12:13.022733 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: your server socket listen backlog is limited to 100 connections Sep 23 03:12:13.022733 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: your mercy for graceful operations on workers is 90 seconds Sep 23 03:12:13.023176 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 03:12:13.023176 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: *** Operational MODE: preforking *** Sep 23 03:12:13.023458 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: *** uWSGI is running in multiple interpreter mode *** Sep 23 03:12:13.023458 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: spawned uWSGI master process (pid: 108941) Sep 23 03:12:13.023668 dv-cinder-768458-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 03:12:13.024584 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: spawned uWSGI worker 1 (pid: 108953, cores: 1) Sep 23 03:12:13.024728 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: spawned uWSGI worker 2 (pid: 108954, cores: 1) Sep 23 03:12:13.024821 dv-cinder-768458-9-iscsi devstack@n-api.service[108941]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 03:12:14.863539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:12:14.863539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: from cryptography.utils import int_from_bytes Sep 23 03:12:14.864223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:12:14.864223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: from cryptography.utils import int_from_bytes Sep 23 03:12:14.879843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:12:14.879843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: from cryptography.utils import int_from_bytes Sep 23 03:12:14.880398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 03:12:14.880398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: from cryptography.utils import int_from_bytes Sep 23 03:12:17.565310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:12:17.565890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:12:17.566021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:12:17.566386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:12:17.566642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:12:17.567026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.567353 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.567680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.567999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.568325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.568727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.569052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.569369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.569695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.569956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.570269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.570592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-9-iscsi {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.570752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 03:12:17.571127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.571222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 03:12:17.571313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.571476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 03:12:17.571582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.571807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.571906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 03:12:17.572090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 03:12:17.572182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.572413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.572547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.572744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.572843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.573133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.573223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.573458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.573674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.573772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.574040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.574656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.574853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.574988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575185 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.575950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576607 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-9-iscsi {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.576909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-9-iscsi {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.577840 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578015 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.578913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.579852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580098 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.580838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581039 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.581857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-9-iscsi {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.582950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.583856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584444 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.584948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.585107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.585260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.585403 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.585576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.585851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586142 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586283 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586283 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586644 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.586946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587709 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.587996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.588941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.589872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590461 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590461 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.590928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.591097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.591240 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.591381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.591724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.591890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592049 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.592992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.593857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.594860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.595941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596236 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.596865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.597898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.598970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599533 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599835 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.599982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.600923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601793 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.601946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602353 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.602928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603514 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.603990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.604119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.604294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.604416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.604626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.607881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.607881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.608941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609023 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.609932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610371 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610812 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.610892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.610984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.611078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.611161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.611242 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.611377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.611504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.611597 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.611689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.611780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.611912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.612045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.612131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.612227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.612227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.612684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.612777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.612866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.612955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.613130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613218 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.613307 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.613529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.613704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.613867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.613947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.614137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.614273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.614467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.614591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.614782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.614882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.615096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.615196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.615406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.615498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.615739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.615854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 03:12:17.616052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.616178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.616374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.616519 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.616713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.616858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617052 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.617842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618024 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.618964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.619904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.620042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.620217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.620355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.620557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.620689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.621422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.621563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.621747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.621884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622066 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.622986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623425 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.623918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624241 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.624896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625501 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.625992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626741 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.626868 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627134 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.627923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628712 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.628885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.629946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.630898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.631848 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.632987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.633790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.633790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634300 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634837 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.634964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635359 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635484 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.635865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.636000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.636127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.636270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.636409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.637859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638515 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638766 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.638902 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.639887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.640938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.641886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.642827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643133 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.643946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.644898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645541 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.645876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.646963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647757 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.647898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648561 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.648862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649485 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.649979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650434 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.650920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651358 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651683 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.651994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.652202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.652339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.652547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.652681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.652863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653488 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.653925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.654851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.655962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.656904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.657983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658486 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.658923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.659853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660462 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660799 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.660997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661133 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.661909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.662969 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663449 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.663894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664701 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.664828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.665952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.666876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667307 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.667969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.668144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.668404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.668554 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.668758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.668891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669204 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.669834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.670974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.671898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672697 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.672985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.673895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.674943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.675898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676688 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.676984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.677906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678229 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.678839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.679949 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.680989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681281 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.681907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682691 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.682997 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.683133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.683812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.683963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684429 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.684910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.685967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686099 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686280 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.686893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687333 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687644 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687821 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.687960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.688904 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.689987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690130 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.690904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691208 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.691950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692258 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692581 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.692897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693508 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693685 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.693988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694118 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694727 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.694899 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695546 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.695941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.696854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.697944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.698902 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.699932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700809 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.700945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.701858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702019 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.702946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.703874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.704817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705425 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.705855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706342 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706652 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.706963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707095 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.707889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708333 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.708974 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.709888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710228 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710495 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.710984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711742 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.711926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712056 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712240 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.712881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.713942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.714122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.714260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.714435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.715908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716538 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716683 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716812 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.716939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.717864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718180 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.718890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719371 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.719813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.720802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.721955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722086 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722265 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722403 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722708 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.722885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.723938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.724917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.725920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.726880 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.727940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.728909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.729956 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.730123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.730298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.730973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731444 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.731947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.732912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733673 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.733990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.734914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.735876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736561 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.736839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.737011 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.737150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.737322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.737701 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.737882 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.738947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739124 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739564 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.739878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.740972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.741900 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.742968 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743285 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743577 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.743886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.744881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.745838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746474 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746647 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.746978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747107 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.747993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748483 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.748952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.749881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.750929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.751888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752677 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.752861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.753943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754583 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.754914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755098 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755538 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755726 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.755855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.756918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.757900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.758992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759796 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.759933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.760911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761099 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.761899 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.762913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.763951 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.764964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.765909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766397 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.766834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.767964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.768154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.768359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.768823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.769172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.769491 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.769818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.770168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.770466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.770776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.771101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.771416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.771723 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.772042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.772231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.772406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.772673 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.772984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.773297 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.773535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.773681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.773893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774449 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.774934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.775844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.776962 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.777656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.777799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.777979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778627 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.778943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.779912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780327 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.780837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.781892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.782834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.783887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784229 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.784918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.785876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786822 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.786961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.787889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788384 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.788834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789675 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.789941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790691 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.790996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791812 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.791943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.792966 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.793922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.794891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795552 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.795969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.796116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.796314 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.796445 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.796685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.796819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797691 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.797823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798458 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.798940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.799885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800692 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.800865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.801963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.802914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803723 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.803860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.804820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.805965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.806930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.807889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.808020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.808210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809573 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.809904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.810839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.811774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.812966 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:12:17.813108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.813327 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.813654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.813969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.814297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.814620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.814943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.815259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.815600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.815921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.816241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.816580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.816900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.817215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.817533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.817865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.818197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.818513 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.818850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.819174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.819500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.819821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.820138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.820472 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.820890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.821117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.821432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.821750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.822072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.822397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.822725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.823063 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.823388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.823717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.824650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.824978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.825330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.825667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 03:12:17.825916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 03:12:17.835717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_db.sqlalchemy.engines [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:17.849488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_db.sqlalchemy.engines [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:17.914132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.context [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2e928b7-7406-4a56-84c2-2a89dd3469c1(cell1) {{(pid=108954) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:12:17.919099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:17.920705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:17.921505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:17.923435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:17.928223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.context [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2e928b7-7406-4a56-84c2-2a89dd3469c1(cell1) {{(pid=108953) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 03:12:17.932684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:17.934848 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_db.sqlalchemy.engines [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:17.935049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:17.935688 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:17.935902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_db.sqlalchemy.engines [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:17.937694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:17.948165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_db.sqlalchemy.engines [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:17.949955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_db.sqlalchemy.engines [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:18.196316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_db.sqlalchemy.engines [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:18.211402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_db.sqlalchemy.engines [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 03:12:18.522482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: WARNING keystonemiddleware.auth_token [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:12:18.529598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: WARNING keystonemiddleware.auth_token [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:12:18.538358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: WARNING keystonemiddleware.auth_token [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:12:18.545116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: WARNING keystonemiddleware.auth_token [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:12:18.879250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: WARNING keystonemiddleware.auth_token [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:12:18.884554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: WARNING keystonemiddleware.auth_token [None req-b384179f-1dd4-4a63-8774-a5f33680f1e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:12:18.890226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae7507a9c0 pid: 108954 (default app) Sep 23 03:12:18.891081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: WARNING keystonemiddleware.auth_token [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 03:12:18.896387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: WARNING keystonemiddleware.auth_token [None req-43df782e-4dd8-4aaa-a3b9-9c3c9075a148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 03:12:18.901546 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae7507a9c0 pid: 108953 (default app) Sep 23 03:12:53.405277 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7933963b-1f6b-4c2e-bb0a-7d2974e50597 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Action: 'create', calling method: .version_select at 0x7fd1b57d99d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-408941334"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:12:55.517976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-620727134", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "803c4c70-2ff9-4ddc-a896-3501f0b2a0a2"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:12:55.523668 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7933963b-1f6b-4c2e-bb0a-7d2974e50597 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.263278 Sep 23 03:12:55.533667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Sep 23 03:12:52 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3266 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 03:12:55.558674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b4441223-1daa-44df-94d9-fba23c4f103e tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b569e550>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:56.008078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b4441223-1daa-44df-94d9-fba23c4f103e tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 200 len: 344 microversion: 2.1 time: 0.468114 Sep 23 03:12:56.008078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:12:55 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 344 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:12:56.081117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] validate_networks() for [('803c4c70-2ff9-4ddc-a896-3501f0b2a0a2', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:12:57.023748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3a0ccdb3-59a3-46cf-94ca-a2d86dcebaad tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b569ee50>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:57.159064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3a0ccdb3-59a3-46cf-94ca-a2d86dcebaad tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 200 len: 344 microversion: 2.1 time: 0.144361 Sep 23 03:12:57.160373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 3/3] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:12:57 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:12:57.462360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2135963311", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "0dfc782a-3c76-41d8-9a94-b4dce4351b9f"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:12:57.547105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:12:57.547610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:12:57.548728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:12:57.549308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:12:57.549989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:12:57.567877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:57.568046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] validate_networks() for [('0dfc782a-3c76-41d8-9a94-b4dce4351b9f', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:12:57.568725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:57.569982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:57.570595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:57.622111 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:12:57.629105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for user 36893da01a1845f5af4921a298abb9eb and project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:12:57.641606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:12:57.644595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:12:57.939162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-76c4938c-6c1e-4156-9158-2379e501e900 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.823292 Sep 23 03:12:57.949315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 1/4] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:12:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 2837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:12:57.967400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ae4a2506-02ec-4714-854b-56cd44939c87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:57.970701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ae4a2506-02ec-4714-854b-56cd44939c87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:12:58.150952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ae4a2506-02ec-4714-854b-56cd44939c87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:12:58.166750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ae4a2506-02ec-4714-854b-56cd44939c87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1217 microversion: 2.1 time: 0.215551 Sep 23 03:12:58.169196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 2/5] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:12:57 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:12:58.177650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cddae2b5-42ee-4839-84e3-20e193df9fe9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b564ca60>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:58.323878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cddae2b5-42ee-4839-84e3-20e193df9fe9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 200 len: 345 microversion: 2.1 time: 0.152822 Sep 23 03:12:58.324992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:12:58 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:12:58.335773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-51a6ff8c-7f72-4427-8139-6a57b67796f7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Action: 'create', calling method: .version_select at 0x7fd1b4e0f0d0>, body: {"snapshot": {"volume_id": "d2ea790c-32df-4307-8cd5-1335bd9a96c7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2033154344"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:12:59.286351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-51a6ff8c-7f72-4427-8139-6a57b67796f7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.954383 Sep 23 03:12:59.292312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 4/7] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Sep 23 03:12:58 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:12:59.298895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3ed5ff3c-a32c-478d-9e2a-5ecd9e494325 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:59.299439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3ed5ff3c-a32c-478d-9e2a-5ecd9e494325 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:12:59.363633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ed5ff3c-a32c-478d-9e2a-5ecd9e494325 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:12:59.372399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3ed5ff3c-a32c-478d-9e2a-5ecd9e494325 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1217 microversion: 2.1 time: 0.084168 Sep 23 03:12:59.382367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:12:59 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:12:59.388095 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-76da3ccf-3188-43de-9074-d3e6b8a1a1fd tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b4569af0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:59.395520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:12:59.396029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:12:59.396923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:12:59.403880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:12:59.404436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:12:59.435754 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:59.445544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:59.447393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:12:59.448114 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:12:59.515566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Getting quotas for project a580adcc8b084ba2b1b657bd1b2a9a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:12:59.524812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Getting quotas for user 415880421b3f4b7896e49188e8d1395c and project a580adcc8b084ba2b1b657bd1b2a9a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:12:59.531379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-76da3ccf-3188-43de-9074-d3e6b8a1a1fd tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.147549 Sep 23 03:12:59.532526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 6/9] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:12:59 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:12:59.541670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-efcff9ab-b6cb-44f0-bff0-85e88b774589 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b4571790>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:59.545545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:12:59.548786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:12:59.673815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-efcff9ab-b6cb-44f0-bff0-85e88b774589 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.104901 Sep 23 03:12:59.673815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 7/10] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Sep 23 03:12:59 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:12:59.675892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-828ac9b4-7776-446b-963b-754e2a63c5df tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b4571dc0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:12:59.707820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-828ac9b4-7776-446b-963b-754e2a63c5df tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.035893 Sep 23 03:12:59.708394 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 8/11] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:12:59 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:00.092388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-393da5ed-7eb6-4f8c-acaa-c055112fa7a1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.827949 Sep 23 03:13:00.095822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 4/12] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:12:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:13:00.102846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-376945ad-3e86-4ee6-a09f-eb74c6496471 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:00.104453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-376945ad-3e86-4ee6-a09f-eb74c6496471 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:00.191352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-376945ad-3e86-4ee6-a09f-eb74c6496471 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:00.196182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-376945ad-3e86-4ee6-a09f-eb74c6496471 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1215 microversion: 2.1 time: 0.096894 Sep 23 03:13:00.198383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 9/13] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:00 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:00.389560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0d07a9fa-93b1-4781-8b86-86915d96e2ac tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:00.390181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0d07a9fa-93b1-4781-8b86-86915d96e2ac tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:00.562818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0d07a9fa-93b1-4781-8b86-86915d96e2ac tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:00.576734 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0d07a9fa-93b1-4781-8b86-86915d96e2ac tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1217 microversion: 2.1 time: 0.190758 Sep 23 03:13:00.577318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 5/14] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:00 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:00.721278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-edb92be5-a876-4301-9442-7f97e70797b1 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b45693a0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:00.784074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-edb92be5-a876-4301-9442-7f97e70797b1 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.068355 Sep 23 03:13:00.784705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 10/15] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:00 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:13:01.219712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-32c89ac4-f2f6-4954-9f98-a75ff5d921c2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:01.220351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-32c89ac4-f2f6-4954-9f98-a75ff5d921c2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:01.308860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-32c89ac4-f2f6-4954-9f98-a75ff5d921c2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:01.324071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-32c89ac4-f2f6-4954-9f98-a75ff5d921c2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1215 microversion: 2.1 time: 0.111535 Sep 23 03:13:01.324879 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 6/16] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:01 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:01.594476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:01.595470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:01.605358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:01.606446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:01.608852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:01.609665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:01.939764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1f4a9d29-6d0f-4114-a583-ee25d69ed027 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b456bca0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:01.939764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1f4a9d29-6d0f-4114-a583-ee25d69ed027 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.088843 Sep 23 03:13:01.939764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 7/17] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:01 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:01.948012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:01.961446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b1b0b1dc-c9ba-461e-b438-1f5492034ee9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1221 microversion: 2.1 time: 0.371638 Sep 23 03:13:01.962040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 11/18] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:01 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1221 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:02.343044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d5eca259-19d1-4cc8-b653-938d04c402e6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:02.343694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d5eca259-19d1-4cc8-b653-938d04c402e6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:02.513592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d5eca259-19d1-4cc8-b653-938d04c402e6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:02.517517 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d5eca259-19d1-4cc8-b653-938d04c402e6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1215 microversion: 2.1 time: 0.178066 Sep 23 03:13:02.519370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 8/19] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:02 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:02.898766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f91ba083-3cca-440b-9509-049d336fabe9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44ec040>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:02.964652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f91ba083-3cca-440b-9509-049d336fabe9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.069456 Sep 23 03:13:02.965324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 12/20] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:02 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:02.979257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:02.980667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:02.994222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:02.997158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:02.998068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:02.998728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:03.116274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:03.123655 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-823f1140-e7ff-4a7d-ba2b-60b5205726fd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1221 microversion: 2.1 time: 0.148706 Sep 23 03:13:03.124289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 13/21] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:02 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:03.178693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1153139920", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d10651e-f809-49e7-bd10-b6e6b7add90a"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:03.253580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] validate_networks() for [('1d10651e-f809-49e7-bd10-b6e6b7add90a', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:13:03.536279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:03.536920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:03.542715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:03.543617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:03.544196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:03.544657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:03.611668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:03.624224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-860a710b-191a-4bf4-914c-d6f8713113b5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1219 microversion: 2.1 time: 0.091656 Sep 23 03:13:03.625271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 14/22] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:03 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:03.953954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:13:03.954448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:13:03.954992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:13:03.955476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:13:03.955972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:13:03.967443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:03.967886 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:03.968697 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:03.969123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:03.979126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-425dc139-a20b-4a10-b2b0-9722834d1ce8 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b607eee0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:03.987688 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Getting quotas for project a28d49e25ce7449f8ae6c33149e67246. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:13:03.991505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Getting quotas for user dbd9a5404ac747d4964d215c96918625 and project a28d49e25ce7449f8ae6c33149e67246. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:13:04.003247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:13:04.005813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:13:04.023227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-425dc139-a20b-4a10-b2b0-9722834d1ce8 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.048877 Sep 23 03:13:04.028404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 15/23] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:03 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:04.130848 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b8090a25-6e8e-4a15-8cde-97ee18ec9b56 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.187598 Sep 23 03:13:04.132048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 9/24] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:13:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:13:04.141069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:04.142032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:04.149615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:04.150886 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:04.152296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:04.153413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:04.276925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: .version_select at 0x7fd1b4508d30>, body: {"keypair": {"name": "tempest-keypair-2125703532"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:04.322447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:04.324557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:13:04.328697 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:13:04.333904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9e8635eb-66ee-41e7-a3c7-7a0c2c29da0a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1221 microversion: 2.1 time: 0.197384 Sep 23 03:13:04.340507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 10/25] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:04 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:04.345226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3a7d95b3-b119-4849-8acd-146e40e3d864 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:04.347295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3a7d95b3-b119-4849-8acd-146e40e3d864 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:04.544216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3a7d95b3-b119-4849-8acd-146e40e3d864 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:04.551636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3a7d95b3-b119-4849-8acd-146e40e3d864 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1222 microversion: 2.1 time: 0.209866 Sep 23 03:13:04.552524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 11/26] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:04 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1222 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:04.643617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:04.645022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:04.656139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:04.657942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:04.658939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:04.659580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:04.996194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:13:04.996194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:13:04.996194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-76d737f7-1c35-4204-895d-7ac163390fd7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.614521 Sep 23 03:13:04.996194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 16/27] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Sep 23 03:13:04 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 616 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:13:04.997920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1393797731", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d10651e-f809-49e7-bd10-b6e6b7add90a"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:04.998347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:04.998347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b84bd2bc-c40c-4954-b4f6-caa4ffe57518 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1219 microversion: 2.1 time: 0.130371 Sep 23 03:13:04.998347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 12/28] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:04 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:04.999027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] validate_networks() for [('1d10651e-f809-49e7-bd10-b6e6b7add90a', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:13:05.048232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-88da218a-5705-4ccf-8edd-8237879da19c tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44f2d30>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:05.103326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-88da218a-5705-4ccf-8edd-8237879da19c tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.071566 Sep 23 03:13:05.107777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 13/29] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:05 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:13:05.357104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:05.358521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:05.366812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.367453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.368219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.369252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.445003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:05.454915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b07bc34c-ada5-4487-a58a-596dd3144454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1221 microversion: 2.1 time: 0.102098 Sep 23 03:13:05.457320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 14/30] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:05 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:05.583255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:13:05.584017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:13:05.584602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:13:05.585235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:13:05.585842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:13:05.596859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.597405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.599292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.600030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.622740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Getting quotas for project a28d49e25ce7449f8ae6c33149e67246. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:13:05.627392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Getting quotas for user dbd9a5404ac747d4964d215c96918625 and project a28d49e25ce7449f8ae6c33149e67246. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:13:05.640707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:13:05.643355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:13:05.785319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:05.786285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:05.793046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.793487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.794284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:05.794861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:05.841797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f0892b67-78c0-4da7-991d-c23f4c8b38fd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.085087 Sep 23 03:13:05.842752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 17/31] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:13:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:13:05.857539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8dcc53cb-ff06-44b6-b686-b132a23e9483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:05.858368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8dcc53cb-ff06-44b6-b686-b132a23e9483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:05.939850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:05.948116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a26e94f1-d203-40fc-848d-08cb7362957d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1219 microversion: 2.1 time: 0.166915 Sep 23 03:13:05.949146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:05 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:05.982552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8dcc53cb-ff06-44b6-b686-b132a23e9483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:05.989877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8dcc53cb-ff06-44b6-b686-b132a23e9483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1222 microversion: 2.1 time: 0.140818 Sep 23 03:13:06.004290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:05 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:06.117323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b6cb64cc-df04-469f-a331-d6d7ae50c56e tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b4494dc0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:06.180040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b6cb64cc-df04-469f-a331-d6d7ae50c56e tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 288 microversion: 2.1 time: 0.067390 Sep 23 03:13:06.186215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 16/34] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:06 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:06.191413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ece6a430-f33d-45e0-be47-683e0c08f900 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b4469ee0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:06.473606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:06.474209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:06.480514 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:06.480961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:06.481712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:06.482138 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:06.573942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ece6a430-f33d-45e0-be47-683e0c08f900 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 202 len: 0 microversion: 2.1 time: 0.384379 Sep 23 03:13:06.578690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 19/35] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Sep 23 03:13:06 2021] DELETE /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:13:06.593857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4c4ca2b9-dcd4-4f81-8c99-28958cc5c7cb tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b448b0d0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:06.611153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:06.627475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ee5c1dce-fb7f-42a2-acd2-cf5b85b492fa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1221 microversion: 2.1 time: 0.153474 Sep 23 03:13:06.633937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 17/36] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:06 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:06.697801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4c4ca2b9-dcd4-4f81-8c99-28958cc5c7cb tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.117760 Sep 23 03:13:06.699154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:06 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:06.966155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:06.966155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:06.973134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:06.973822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:06.974785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:06.975394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:07.006654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-05f588d9-f57c-42cb-adaf-e9ad8659934e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:07.011079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-05f588d9-f57c-42cb-adaf-e9ad8659934e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:07.052816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:07.061367 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d2ccb438-fa66-4f36-b37d-0422b41175fc tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1211 microversion: 2.1 time: 0.099722 Sep 23 03:13:07.062558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 18/38] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:06 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:07.096053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-05f588d9-f57c-42cb-adaf-e9ad8659934e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:07.102966 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-05f588d9-f57c-42cb-adaf-e9ad8659934e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1222 microversion: 2.1 time: 0.099828 Sep 23 03:13:07.112543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:07 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:07.650171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:07.651875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:07.658253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:07.658816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:07.659650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:07.660150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:07.711174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3e4eee45-99bd-461d-92d7-5e03b6b7b157 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b448b430>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:07.740612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:07.750989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cbf7cb90-5f6c-45d8-93ad-69c7ee204296 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1213 microversion: 2.1 time: 0.104871 Sep 23 03:13:07.752087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 19/40] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:07 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:07.772278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3e4eee45-99bd-461d-92d7-5e03b6b7b157 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.064976 Sep 23 03:13:07.772978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:07 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:08.079043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:08.079647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:08.085390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.085831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.086655 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.087000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.120077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:08.120838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:08.127664 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.127664 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.128336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.128800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.186650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:08.190139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:08.199700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-469d21b4-d4de-4645-9051-5564e3fa4cd8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1226 microversion: 2.1 time: 0.083075 Sep 23 03:13:08.200777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:08 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:08.207318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ef802270-ec43-4be6-875b-bbd909496aea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1211 microversion: 2.1 time: 0.131912 Sep 23 03:13:08.208040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:08 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:08.763499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-195831578", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14c1ac36-0e52-4076-99c3-1a39144cff3e"}], "security_groups": [{"name": "tempest-securitygroup--1711412338"}], "key_name": "tempest-keypair-2125703532", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:08.775110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:08.775693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:08.784599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.785375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.786303 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:08.786882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:08.859541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:08.868396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6e214865-d6dd-4e03-a00e-d0444c3667aa tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1213 microversion: 2.1 time: 0.097335 Sep 23 03:13:08.869104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:08 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:08.870375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] validate_networks() for [('14c1ac36-0e52-4076-99c3-1a39144cff3e', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:13:08.873678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0708c4c1-cc97-4674-8a92-4c5b5069ec83 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44f2d30>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:08.914296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0708c4c1-cc97-4674-8a92-4c5b5069ec83 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.033982 Sep 23 03:13:08.914296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:08 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:09.219022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:09.220338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:09.226748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.227467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.228986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.229657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.258864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:13:09.259341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:13:09.259765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:13:09.260167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:13:09.260593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:13:09.269849 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.270292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.271124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.271562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.288690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:13:09.292975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:13:09.295326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.301909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2b1bdd75-d2bd-4941-98d6-4d77929937e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1226 microversion: 2.1 time: 0.086532 Sep 23 03:13:09.311069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 23/46] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:09 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:09.311069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:09.311069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:09.313926 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.314433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.315215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.315656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.324554 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:13:09.326765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:13:09.377485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.385318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1f7b7b91-f94c-4dc1-b081-35e5d447381e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1211 microversion: 2.1 time: 0.081380 Sep 23 03:13:09.386112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 24/47] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:09 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:09.478662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7adc5b03-ab87-4b6b-9566-c8b241bbec15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.718699 Sep 23 03:13:09.482398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 24/48] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Sep 23 03:13:08 2021] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:13:09.490225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:09.490841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:09.548696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.557490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.559278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.560482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6e657908-909e-4f7a-9323-4c0bf4f19c98 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1281 microversion: 2.20 time: 0.074798 Sep 23 03:13:09.564837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:09 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:09.885406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:09.886014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:09.891806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.892250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.893042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:09.893474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:09.924550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e4b9ae68-fa2b-488d-863a-11f34cd4a550 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44b1e50>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:09.953661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e4b9ae68-fa2b-488d-863a-11f34cd4a550 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.032924 Sep 23 03:13:09.953907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:09.958551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 26/50] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:09 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:09.961202 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-207dc43b-500c-4a40-8872-b1826ad2bdc5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1213 microversion: 2.1 time: 0.079901 Sep 23 03:13:09.961905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 25/51] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:09 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:10.318344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:10.319071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:10.326353 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.326802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.327560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.327989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.390324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:10.404005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3678ff57-9b15-414a-9890-441ae6885c99 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1226 microversion: 2.1 time: 0.089157 Sep 23 03:13:10.405918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:10.407082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:10.413229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.415722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:10 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:10.415858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.415858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.415858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.476853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:10.484769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b0bad838-af93-4591-a33a-783c17344343 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1211 microversion: 2.1 time: 0.083272 Sep 23 03:13:10.485418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:10 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:10.578490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:10.579094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:10.629145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:10.639499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:10.641189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:10.642313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d415b0e8-cad9-4815-82b7-7774e2815b67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1281 microversion: 2.20 time: 0.067657 Sep 23 03:13:10.642871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 28/54] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:10.965018 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b0a9e52b-5c87-4610-9b95-637d9961a156 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44dca60>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:10.979759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:10.981292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:10.987711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.990415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.990415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:10.990415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:10.994973 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b0a9e52b-5c87-4610-9b95-637d9961a156 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 200 len: 287 microversion: 2.1 time: 0.033703 Sep 23 03:13:10.995786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:10 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:11.053179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.061068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f416958d-f647-4ff5-aa9e-a1e01082f1f5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1213 microversion: 2.1 time: 0.086531 Sep 23 03:13:11.061636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 29/56] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:10 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:11.420883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:11.421612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:11.427461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.427909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.428745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.429133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.492133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.506340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:11.507037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:11.507909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-20d0c3b3-93df-4574-bdbe-ed90fee962e0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1218 microversion: 2.1 time: 0.083636 Sep 23 03:13:11.509204 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:11 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:11.513194 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.513635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.514390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.514822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.591364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.598548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-73064fc6-c08a-4e98-9992-727289ce58de tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1267 microversion: 2.1 time: 0.096147 Sep 23 03:13:11.599121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:11 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:11.662160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:11.663168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:11.669862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.670607 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.671602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:11.672202 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:11.739047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.751103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.752722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:11.760567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f730a036-8402-4267-968f-e178cd18a608 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1277 microversion: 2.20 time: 0.097471 Sep 23 03:13:11.760567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 29/59] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:11 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:12.005667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-097e9f5f-d22e-4f2d-bd60-467a8cd58d12 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44a7940>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.044250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-097e9f5f-d22e-4f2d-bd60-467a8cd58d12 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] HTTP exception thrown: Snapshot b96f15e4-eebe-414d-b142-b9d54e306ad8 could not be found. Sep 23 03:13:12.044893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-097e9f5f-d22e-4f2d-bd60-467a8cd58d12 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Returning 404 to user: Snapshot b96f15e4-eebe-414d-b142-b9d54e306ad8 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:13:12.045757 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-097e9f5f-d22e-4f2d-bd60-467a8cd58d12 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8" status: 404 len: 111 microversion: 2.1 time: 0.043937 Sep 23 03:13:12.047612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/os-snapshots/b96f15e4-eebe-414d-b142-b9d54e306ad8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:13:12.054164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a3250233-d0a6-41f3-b506-ae7b912f5090 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44b4700>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.079698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.080190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:12.108772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.109240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.110049 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.110489 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.192697 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.200030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ffd4165e-5055-4f76-aa6c-156a0fdc526f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1269 microversion: 2.1 time: 0.125870 Sep 23 03:13:12.200706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 32/61] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:12.351352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a3250233-d0a6-41f3-b506-ae7b912f5090 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 202 len: 0 microversion: 2.1 time: 0.298330 Sep 23 03:13:12.351352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 30/62] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:13:12 2021] DELETE /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:13:12.361034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e6c47de7-a7a3-4e1a-af27-639800cefdc6 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b445a9d0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.459809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e6c47de7-a7a3-4e1a-af27-639800cefdc6 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 200 len: 344 microversion: 2.1 time: 0.104947 Sep 23 03:13:12.461119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:13:12.534073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.535291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:12.545487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.546397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.548055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.548720 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.622610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.623243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:12.653989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.654085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.662478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.664030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.753215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.764282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bafe9bd3-f6f1-4415-a8eb-ce4755e1b7e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1218 microversion: 2.1 time: 0.237080 Sep 23 03:13:12.771263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 31/64] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:12.779331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:12.781813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:12.789141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.795129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.795816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.797269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:12.797889 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:12.799100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-515b00f7-7376-46b6-ba83-8367271ebac5 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1273 microversion: 2.1 time: 0.186442 Sep 23 03:13:12.807459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:12.931630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.940305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.942116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:12.944111 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ebd677c0-db7f-4b0c-b20a-acff829725cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1277 microversion: 2.20 time: 0.171747 Sep 23 03:13:12.944892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 32/66] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:12 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:13.217557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.218315 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:13.226000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.226929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:13.228118 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.228817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:13.310023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:13.340666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-af7f5eac-9c64-4128-b221-581b34ce810f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1275 microversion: 2.1 time: 0.125636 Sep 23 03:13:13.341341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:13 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:13.474699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-48f065ee-cd77-4483-8147-e6ed283c99c7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b442cca0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.703264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-48f065ee-cd77-4483-8147-e6ed283c99c7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] HTTP exception thrown: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. Sep 23 03:13:13.704570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-48f065ee-cd77-4483-8147-e6ed283c99c7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Returning 404 to user: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:13:13.705654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-48f065ee-cd77-4483-8147-e6ed283c99c7 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 404 len: 109 microversion: 2.1 time: 0.235810 Sep 23 03:13:13.706291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 33/68] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:13:13 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:13:13.719988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-648ca908-6d8d-426e-b632-ff3552d045ab tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44a7700>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.788269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.789861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:13.792304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-648ca908-6d8d-426e-b632-ff3552d045ab tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] HTTP exception thrown: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. Sep 23 03:13:13.793601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-648ca908-6d8d-426e-b632-ff3552d045ab tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Returning 404 to user: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:13:13.794472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-648ca908-6d8d-426e-b632-ff3552d045ab tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 404 len: 109 microversion: 2.1 time: 0.078133 Sep 23 03:13:13.795402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:13:13 2021] DELETE /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:13:13.796806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.797796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:13.798789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.799431 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:13.806956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-41bb2c39-e131-44d2-be8d-4d9f93cd9ea9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Calling method '.version_select at 0x7fd1b44d5f70>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.891242 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-41bb2c39-e131-44d2-be8d-4d9f93cd9ea9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] HTTP exception thrown: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. Sep 23 03:13:13.892035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-41bb2c39-e131-44d2-be8d-4d9f93cd9ea9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] Returning 404 to user: Volume d2ea790c-32df-4307-8cd5-1335bd9a96c7 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:13:13.893235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-41bb2c39-e131-44d2-be8d-4d9f93cd9ea9 tempest-VolumesSnapshotsTestJSON-1174656026 tempest-VolumesSnapshotsTestJSON-1174656026-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7" status: 404 len: 109 microversion: 2.1 time: 0.093494 Sep 23 03:13:13.894324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:13:13 2021] GET /compute/v2.1/os-volumes/d2ea790c-32df-4307-8cd5-1335bd9a96c7 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:13:13.906444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:13.911749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:13.928021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.931885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:13.934556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:13.935212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:14.041017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.054127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-75fe2478-6295-442f-9999-123668be7303 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1274 microversion: 2.1 time: 0.266706 Sep 23 03:13:14.056840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 34/71] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:13 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:14.072129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:14.072939 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:14.090468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:14.090853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:14.098582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:14.098582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:14.292351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.304802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.330157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.332048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2a8bf6bc-4240-438a-b6c3-89a2061c627f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1277 microversion: 2.20 time: 0.273708 Sep 23 03:13:14.333274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 35/72] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:14 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:14.357720 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:14.358550 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:14.366521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:14.367219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:14.368593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:14.369221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:14.485357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.502129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f99129cb-4655-43f0-bf55-5f1a8301e187 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.604661 Sep 23 03:13:14.503253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 38/73] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:13 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:14.706578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:14.723308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-212e1df0-7173-4492-94e5-dc697a78f2d6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.364983 Sep 23 03:13:14.737031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:14 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:15.072087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:15.072833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:15.080209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.082473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.083571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.085352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.190621 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:15.216242 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-41acfd74-aea4-46fc-86e3-4c778d3a3973 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.147765 Sep 23 03:13:15.222622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:15 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:15.350990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:15.351600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:15.358308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.359044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.359997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.360884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.433620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:15.442270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:15.443771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:15.445711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ecf2700d-4741-4cb3-ab03-fee034cacf62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.097757 Sep 23 03:13:15.445711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 37/76] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:15 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:15.519074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:15.519684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:15.536588 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.537312 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.539358 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.541822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.741967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:15.743735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:15.751419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.752218 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:15.753308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:15.753933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:16.048237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.073699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9e5084d3-7a7f-4d0f-8080-f9e8ec564dbf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.550018 Sep 23 03:13:16.073699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:15 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:16.149081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.174163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a6b9afc8-3775-4f48-bb95-a715fa454c9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.435290 Sep 23 03:13:16.176879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 38/78] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:15 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:16.239719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:16.240478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:16.261945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:16.263787 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:16.265596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:16.267061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:16.476126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:16.477008 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:16.499669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:16.500305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:16.502655 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:16.503323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:16.644896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.657259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2338e056-0713-4066-be85-2affa36aeb09 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.426259 Sep 23 03:13:16.657918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 41/79] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:16 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:16.920694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.936019 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.939061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:16.944659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c58dbdbe-cae0-4da1-987b-d2d899557b9e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.478733 Sep 23 03:13:16.957644 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 39/80] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:16 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:17.095406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:17.095406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:17.099878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.100560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.101627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.102247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.194460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:17.195624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:17.214623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.214623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.214623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.214623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.273444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:17.281673 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3d12d04b-a612-41eb-bd9c-b091cf45cb1a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.195877 Sep 23 03:13:17.284942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 42/81] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:17 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:17.418214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:17.428788 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cc1c3607-32a0-44f1-acd7-98973bee9bd0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.239108 Sep 23 03:13:17.431388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:17 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:17.651316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-27b98462-5b9f-4cd8-bf58-d034c392d4f2 req-bee58b21-c3d9-4a35-b5ea-5e4c670ab96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565f86c9-78ca-4856-9083-6ed4db043086", "tag": "c5c1a228-41bc-4fd1-9c8e-6b4d92214b55"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:17.655842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:17.655842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:13:17.675113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-27b98462-5b9f-4cd8-bf58-d034c392d4f2 req-bee58b21-c3d9-4a35-b5ea-5e4c670ab96c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.675645 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-27b98462-5b9f-4cd8-bf58-d034c392d4f2 req-bee58b21-c3d9-4a35-b5ea-5e4c670ab96c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.715141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-a99f215f-12b3-48d2-a5a8-b71c8f4a8c82 req-427dec2c-f17f-42db-82d9-98c0b8fbf190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4135490e-a5b9-4f7f-b01b-60d0a6bf7d17", "tag": "fe931329-5d49-473e-b438-0f6e1c7ff098"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:17.717387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:17.717387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:13:17.739296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a99f215f-12b3-48d2-a5a8-b71c8f4a8c82 req-427dec2c-f17f-42db-82d9-98c0b8fbf190 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.739753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a99f215f-12b3-48d2-a5a8-b71c8f4a8c82 req-427dec2c-f17f-42db-82d9-98c0b8fbf190 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.741354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-27b98462-5b9f-4cd8-bf58-d034c392d4f2 req-bee58b21-c3d9-4a35-b5ea-5e4c670ab96c service nova] Creating event network-changed:c5c1a228-41bc-4fd1-9c8e-6b4d92214b55 for instance 565f86c9-78ca-4856-9083-6ed4db043086 on hv-cinder-76845 Sep 23 03:13:17.753035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-27b98462-5b9f-4cd8-bf58-d034c392d4f2 req-bee58b21-c3d9-4a35-b5ea-5e4c670ab96c service nova] Acquired lock "compute-rpcapi-router" {{(pid=108954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 23 03:13:17.754935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.755741 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.763178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.763635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.780134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.compute.rpcapi [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 23 03:13:17.781704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0feac034-7573-4284-b494-50596ab9c866 None None] Releasing lock "compute-rpcapi-router" {{(pid=108954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 23 03:13:17.786866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-a99f215f-12b3-48d2-a5a8-b71c8f4a8c82 req-427dec2c-f17f-42db-82d9-98c0b8fbf190 service nova] Creating event network-changed:fe931329-5d49-473e-b438-0f6e1c7ff098 for instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 on hv-cinder-76845 Sep 23 03:13:17.787391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a99f215f-12b3-48d2-a5a8-b71c8f4a8c82 req-427dec2c-f17f-42db-82d9-98c0b8fbf190 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108953) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 23 03:13:17.792339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.792906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.797299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.797904 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.818115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.compute.rpcapi [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 23 03:13:17.820314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0feac034-7573-4284-b494-50596ab9c866 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310045 Sep 23 03:13:17.821386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] Releasing lock "compute-rpcapi-router" {{(pid=108953) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 23 03:13:17.822168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 43/83] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:17.838895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:17.839729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:17.868651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.868651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.868651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.868651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.869093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7d9ef781-35a8-48dd-9e9a-0b083773c11c None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285536 Sep 23 03:13:17.869093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 41/84] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:13:17.931433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:17.941646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-11ad7a03-6572-418f-adec-259753a10262 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.113862 Sep 23 03:13:17.952351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 44/85] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:17 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:17.964379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:17.965132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:17.975028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.975544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:17.976964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:17.977505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:18.055868 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:18.065315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:18.068857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:18.082375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d1a5eb31-8271-4ce2-a0ac-653afa043f82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.110694 Sep 23 03:13:18.082375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 42/86] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:17 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:18.299518 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:18.299852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:18.306330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:18.306772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:18.307538 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:18.307992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:18.446002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:18.446955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:18.447747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:18.453894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:18.454536 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:18.455512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5cdcb7b3-455f-4646-85ed-661fbcc4514b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.160165 Sep 23 03:13:18.455738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:18.456307 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:18.472681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 45/87] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:18 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:18.625146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:18.632463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c7c3552f-4e26-47a3-bf7b-cc3d78ae6794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.189333 Sep 23 03:13:18.633047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 43/88] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:18 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:19.000584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:19.000584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:19.000584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.000584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.001568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.001568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.053704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.063193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-36928968-a9f2-4fe3-8af2-bf34a8e7e161 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.093747 Sep 23 03:13:19.064544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 46/89] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:18 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:19.090892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:19.091495 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:19.097819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.098329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.099292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.099722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.165453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.177195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.177820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.184828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fc27ca77-8cb2-4d2b-9759-95e49d2e5c1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.098517 Sep 23 03:13:19.185766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 44/90] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:19 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:19.473798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:19.474686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:19.482328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.483333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.484396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.484991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.649852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:19.650933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:19.659219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.662203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.662203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:19.662203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:19.829614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.838823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-522730ff-7874-4e8e-ba41-bf570a658169 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.368166 Sep 23 03:13:19.842828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:19 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:19.865772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:19.874205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b2576d57-5e22-4830-ae14-5e3c24b85871 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.227997 Sep 23 03:13:19.874783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 45/92] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:19 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:20.082834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:20.083465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:20.090850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.091333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.092135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.092601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.168838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:20.176812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-601ce3b6-c05b-455d-9b80-f694d105d2a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.097971 Sep 23 03:13:20.183925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 48/93] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:20 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:20.202207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:20.203021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:20.210260 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.212875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.214095 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.215296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.295994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:20.300474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:20.302432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:20.304022 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c991b198-3394-4c6b-b8d2-d95b55e09736 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.105349 Sep 23 03:13:20.304619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 46/94] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:20 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:20.859274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:20.859901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:20.866548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.867009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.867769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.868861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.890898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:20.891502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:20.903943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.904390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:20.905457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:20.905894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:21.047868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.062049 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fc0e8885-383e-4ee3-babc-874c2d09ef44 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.206409 Sep 23 03:13:21.064858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 49/95] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:20 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:21.092673 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.155277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-48fc91d2-32aa-48eb-bc6d-4eef957ef2fc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.235319 Sep 23 03:13:21.155277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 47/96] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:20 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:21.195084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:21.196156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:21.206666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:21.207322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:21.208090 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:21.208533 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:21.285825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.293869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c3e500f3-8f57-4a4d-9bf8-f28056005919 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.102760 Sep 23 03:13:21.303512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 50/97] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:21 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:21.326879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:21.328414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:21.335413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:21.335949 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:21.337354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:21.337859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:21.422896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.441709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.441709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:21.441709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-153c328f-4e1d-4cb8-ba44-11456b8b68ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.112576 Sep 23 03:13:21.442149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 48/98] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:21 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:22.080664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:22.081343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:22.087554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.088362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.089820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.091687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.160358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:22.161337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:22.167948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.169448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.169448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.170526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.256504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.264511 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8a15ce96-8634-4d5e-b89c-604776491239 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.187402 Sep 23 03:13:22.265440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 51/99] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:22 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:22.309925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:22.310635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:22.316832 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.317499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.318446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.319013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.389458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.396890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d21a6848-6dcd-4711-96a3-2eb700e2615f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.240367 Sep 23 03:13:22.397468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:22 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:22.451856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:22.453358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:22.455597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.460239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.464730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-48518732-815a-4385-9055-b0bfcf214acd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.158452 Sep 23 03:13:22.474939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:22 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:22.478905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.495752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:22.495752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:22.565324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.574463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.576136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:22.577247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-42b7e027-c4b9-4ca7-8649-ba3266f54754 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.129413 Sep 23 03:13:22.577804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 50/102] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:22 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:23.286592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:23.287316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:23.295572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.296191 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.297182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.297613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.414685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:23.415343 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:23.426980 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.427279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.428475 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.429079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.470756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.480829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-90084f39-70d0-445c-8b1f-9c8466b0678e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.201105 Sep 23 03:13:23.487313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 53/103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:23 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:23.506298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:23.507128 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:23.514887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.515468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.516399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.517037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.602907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.608729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.609181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-86b49b35-e9a1-4a5a-9747-9c08a4b7a10c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.199007 Sep 23 03:13:23.610234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:23 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:23.615282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:23.616141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:23.618310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d7aaa939-701f-4cb4-81c1-dbe206886fae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.135120 Sep 23 03:13:23.619227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 54/105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:23 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:23.624073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.624777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.625864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:23.626521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:23.695347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.703267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.704838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:23.705946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-97ef9ddb-c243-4a73-ad5a-71ab6223e872 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.094370 Sep 23 03:13:23.706706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 52/106] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:23 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:24.506117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:24.506735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:24.514441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.517890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.517890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.517890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.629927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:24.629927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:24.635868 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.636316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.637105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.637535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.664370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.672104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0d6e7172-6700-4bb2-b624-010e9d8558c7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.176836 Sep 23 03:13:24.672687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 55/107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:24 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:24.676875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:24.677489 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:24.683872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.684195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.684986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.685416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.751479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.758704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ddbdb292-e08c-4448-9213-debeb51ed449 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.085045 Sep 23 03:13:24.768043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 56/108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:24 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:24.768267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.768363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:24.768363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:24.770279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.770393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-317785ae-2255-46b8-9c37-490df16e733f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.145540 Sep 23 03:13:24.770723 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.771151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 53/109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:24 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:24.771615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:24.772053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:24.832152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.840532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.842016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:24.843092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aecc3ab4-3f21-4581-b5d9-a85d6911b27a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.082834 Sep 23 03:13:24.843641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 57/110] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:24 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:25.689330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:25.689936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:25.696140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.696601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.697512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.697760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.775313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:25.776000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:25.786055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.786055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.786055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.786055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.825318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:25.832559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3ae02f34-08e1-46f6-8d32-c8c46ae80cb1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.146648 Sep 23 03:13:25.833138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 54/111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:25 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:25.837429 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:25.838024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:25.843529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.843975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.844755 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.845188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.863084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:25.871253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2f19229b-9950-4ec6-b925-6b42c3b6dd5d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.099737 Sep 23 03:13:25.871809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 58/112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:25 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:25.890729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:25.891578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:25.900299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.900846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.901592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:25.902029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:25.967440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:25.980783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:25.982359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:25.983468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aaede171-3753-4fc6-99d1-a1ae9d458e5b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.110597 Sep 23 03:13:25.994956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 59/113] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:25 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:25.996172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:26.004059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d36532fe-d076-498b-8141-2d8475fc0eb4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.169971 Sep 23 03:13:26.004749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 55/114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:25 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:26.849985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:26.850592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:26.856844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:26.857282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:26.858037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:26.858463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:26.886770 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:26.887378 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:26.893175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:26.893618 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:26.894371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:26.894842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:26.955498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:26.962626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-26957873-063f-4e3d-a3f2-30566812fa7f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.079482 Sep 23 03:13:26.963198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 56/115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:26 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:26.981912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:26.989379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b340c3f4-0fa0-4bc3-b4b5-9527b9cf5f7b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.143741 Sep 23 03:13:26.989937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 60/116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:26 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:27.000896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:27.001506 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:27.008879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.008879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:27.008879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.009189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:27.020783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:27.021385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:27.027241 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.027677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:27.028430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.028871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:27.075702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:27.089310 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:27.090252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:27.091362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3ba8fb60-f9b0-4d5e-abee-8e41d46f6735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.094163 Sep 23 03:13:27.091903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 57/117] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:26 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:27.153314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:27.160342 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4af51d8d-b629-4cb4-8fdc-f46d2b0df40f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.143456 Sep 23 03:13:27.160929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 61/118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:27 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:27.979234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:27.979759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:27.985898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.986335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:27.987091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:27.987515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.006310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:28.006921 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:28.013292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.013736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.014494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.014925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.045742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.053059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d877bcff-d218-44d8-87f3-e592b870670b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.077557 Sep 23 03:13:28.053622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 58/119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:27 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:28.108766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:28.109370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:28.115482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.116095 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.117077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.118011 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.138589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.146239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-df5c87f8-e25e-4122-a082-2d95825057d9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.143546 Sep 23 03:13:28.146808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 62/120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:28 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:28.177254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:28.177855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:28.182419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.184172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.184647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.185410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:28.185836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:28.190084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.191581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.192700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-77412634-d3c4-489f-b5bb-a6069d9e5e17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.087567 Sep 23 03:13:28.193248 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 59/121] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:28 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:28.302482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:28.309608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-18074d7e-b9e0-404e-9df7-2ff805a316c9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.136005 Sep 23 03:13:28.310164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 63/122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:28 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:29.069892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:29.070491 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:29.076284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.076752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.077488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.077918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.136728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.143740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a08eecf3-5e4c-4377-977a-2f9d83c7276a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.077506 Sep 23 03:13:29.144292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 60/123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:29 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:29.162498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:29.163102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:29.169148 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.169588 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.170431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.170747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.210487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:29.211935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:29.217740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.218179 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.218937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.219356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.279373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.286974 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.288463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.290080 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8cb76bca-d5e7-44b8-8cb9-e3a20db7da67 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.083170 Sep 23 03:13:29.290728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 61/124] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:29 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:29.291484 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.298681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2cfef28a-0640-4a86-9090-b8f3d7be09a3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.139830 Sep 23 03:13:29.299232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 64/125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:29 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:29.326161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:29.326704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:29.332701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.333144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.333885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:29.334309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:29.455526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:29.463536 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8afac64d-6cc8-49c7-a21e-649b7d09427c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.140887 Sep 23 03:13:29.464094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 62/126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:29 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:30.160341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:30.160962 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:30.166699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.167274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.167866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.168293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.265340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:30.274201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3ad81b73-61ed-41e0-b76d-f3672984dde7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1282 microversion: 2.1 time: 0.117411 Sep 23 03:13:30.276085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 65/127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:30 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:30.313457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:30.315703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:30.318242 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:30.318977 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:30.325326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.329914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.329914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.329914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.330182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.330182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.330182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.330816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.463157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:30.476439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:30.479085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:30.481032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cb3e515c-40ac-430d-b060-2a5edfa238cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1333 microversion: 2.20 time: 0.173267 Sep 23 03:13:30.491869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 63/128] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:30 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:30.491869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:30.491869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:30.497772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.498238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.499167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:30.499692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:30.652958 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:30.668755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d5d515f9-70c6-465d-b489-5d13a1ba148e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.357341 Sep 23 03:13:30.669824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 66/129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:30 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:31.112272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.128026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cec229c9-06b6-4069-9c9b-9d6fe5ad3c2f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.644733 Sep 23 03:13:31.128776 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 64/130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:30 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:31.292427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:31.293074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:31.302758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.303457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.304439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.305699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.435774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.445207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d9e7e548-1c34-4c7b-94e2-5536b72745af tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1280 microversion: 2.1 time: 0.157205 Sep 23 03:13:31.453120 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 67/131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:31 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:31.502523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:31.503731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:31.514928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.519406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.519406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.519406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.611787 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.622541 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.624517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.625862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-62249af8-8a93-42a2-bab9-51bea9fb851e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1339 microversion: 2.20 time: 0.127303 Sep 23 03:13:31.638106 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 65/132] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:31 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:31.685822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:31.686475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:31.704679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.705255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.706095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.706502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.792054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-cf6b4aa2-dd01-48bb-ac34-4ac431eec43c req-9476deee-e8be-48ce-9080-4bd30bd0b82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ba4276-abfb-4947-920f-a0cc8dffab54", "tag": "a49c2a6f-b48c-430a-a827-5f061c7c60c2"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:31.793687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:31.793687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:13:31.801322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-cf6b4aa2-dd01-48bb-ac34-4ac431eec43c req-9476deee-e8be-48ce-9080-4bd30bd0b82a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:31.801769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-cf6b4aa2-dd01-48bb-ac34-4ac431eec43c req-9476deee-e8be-48ce-9080-4bd30bd0b82a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:31.831859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-cf6b4aa2-dd01-48bb-ac34-4ac431eec43c req-9476deee-e8be-48ce-9080-4bd30bd0b82a service nova] Creating event network-changed:a49c2a6f-b48c-430a-a827-5f061c7c60c2 for instance 97ba4276-abfb-4947-920f-a0cc8dffab54 on hv-cinder-76845 Sep 23 03:13:31.838914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-cf6b4aa2-dd01-48bb-ac34-4ac431eec43c req-9476deee-e8be-48ce-9080-4bd30bd0b82a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051052 Sep 23 03:13:31.840271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 66/133] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:31.976163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:31.984080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5d737675-d865-4c54-a3dc-f52278d539f7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.302085 Sep 23 03:13:31.987378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 68/134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:31 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:32.145989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:32.146733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:32.153856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.154470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.155393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.155972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.464102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:32.464813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:32.471476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.472182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.473368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.474107 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.652397 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:32.661319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:32.670297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-209fee12-4ae4-47df-a1d6-cc1e64c8d8ff tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.528154 Sep 23 03:13:32.671731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 67/135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:32 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:32.674966 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6873fd60-2bce-4070-bd92-95781ee5734d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.215614 Sep 23 03:13:32.676905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 69/136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:32 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:32.680711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:32.681793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:32.702899 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.703514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.704406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:32.705003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:32.772380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:32.780993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:32.782539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:32.783624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-82c853a8-ce4b-47f1-b246-28d27b997a62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1339 microversion: 2.20 time: 0.107945 Sep 23 03:13:32.784177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 68/137] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:32 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:33.008807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:33.011117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:33.022724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.023172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.023983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.024414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.255601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-2d441b59-5f98-42bb-9551-3af5e6165f8e req-00aea8b7-d10a-4b52-a859-aa8abd5e0cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3e7808-544d-464f-a759-648393c4f9b8", "tag": "91d8a60b-64c2-40d5-b3f2-d768b237086a"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:33.257530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:33.257530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:13:33.266684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-2d441b59-5f98-42bb-9551-3af5e6165f8e req-00aea8b7-d10a-4b52-a859-aa8abd5e0cfd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.267189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-2d441b59-5f98-42bb-9551-3af5e6165f8e req-00aea8b7-d10a-4b52-a859-aa8abd5e0cfd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.282898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-2d441b59-5f98-42bb-9551-3af5e6165f8e req-00aea8b7-d10a-4b52-a859-aa8abd5e0cfd service nova] Creating event network-changed:91d8a60b-64c2-40d5-b3f2-d768b237086a for instance 2f3e7808-544d-464f-a759-648393c4f9b8 on hv-cinder-76845 Sep 23 03:13:33.289739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-2d441b59-5f98-42bb-9551-3af5e6165f8e req-00aea8b7-d10a-4b52-a859-aa8abd5e0cfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037769 Sep 23 03:13:33.291094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 69/138] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:13:33.300474 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:33.314303 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-016c3490-5ece-4d75-bc4c-02d548f17894 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.309014 Sep 23 03:13:33.316517 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:33 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:33.691660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:33.692803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:33.693227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:33.694407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:33.701776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.702537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.702875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.703386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.703888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.704611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.704827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.705165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.955441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:33.964084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2b4d0803-dc3d-49a8-b821-5bb0663e3fa0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.276652 Sep 23 03:13:33.969542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:33 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:33.970409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:33.971263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:33.978366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.979034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:33.979844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:33.980659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:34.006976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:34.014166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cee722a0-7df1-4e1b-bb94-6f328e21a026 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.324753 Sep 23 03:13:34.024159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:33 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:34.169294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:34.178928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:34.180785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:34.181943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cf151cbe-4610-4914-a6ac-3620330cdd81 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.215864 Sep 23 03:13:34.182500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 71/142] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:33 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:34.331309 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:34.332109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:34.338911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:34.339348 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:34.340131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:34.340584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:34.416098 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-736d16a9-90d7-4393-934b-a25741fc3ea6 req-5a9af5ac-2d84-45d0-878f-671f183352e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:34.422280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:34.422280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:13:34.449516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-736d16a9-90d7-4393-934b-a25741fc3ea6 req-5a9af5ac-2d84-45d0-878f-671f183352e9 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:34.451853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-736d16a9-90d7-4393-934b-a25741fc3ea6 req-5a9af5ac-2d84-45d0-878f-671f183352e9 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:34.465054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-736d16a9-90d7-4393-934b-a25741fc3ea6 req-5a9af5ac-2d84-45d0-878f-671f183352e9 service nova] Creating event network-changed:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:13:34.470238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-736d16a9-90d7-4393-934b-a25741fc3ea6 req-5a9af5ac-2d84-45d0-878f-671f183352e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059031 Sep 23 03:13:34.471131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 72/143] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:34.541297 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:34.548440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e1a15ef4-18d3-4f1d-93af-1af4708e15d3 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.220900 Sep 23 03:13:34.558715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:34 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:34.981921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:34.982615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:34.988865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:34.989311 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:34.990066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:34.990492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.030990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:35.031871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:35.037777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.038432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.040163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.040632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.120250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.127915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6f8d5e4c-5103-4c31-a54e-db5bf9ba5cb5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.149949 Sep 23 03:13:35.128505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:34 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:35.178973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.186354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c681c664-7387-470d-a063-1f8db72772e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.159038 Sep 23 03:13:35.186915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:35 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:35.202070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:35.202679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:35.208574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.209022 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.209782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.210215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.331557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.347937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.347937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.347937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2d177d24-ab78-472d-b0d4-55c959776ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.146724 Sep 23 03:13:35.348236 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 74/147] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:35 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:35.577123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:35.577661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:35.583678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.584123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.584908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:35.585333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:35.714984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:35.724009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce800bad-86e4-4b63-8f63-593843dad9bd tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.149599 Sep 23 03:13:35.724009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:35 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:36.144985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:36.145619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:36.151554 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.152004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.152775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.153203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.202857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:36.203556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:36.209402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.209852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.213881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.213881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.280385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.287977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ff0d605e-7e9f-4a7c-b107-375adddc2802 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.146568 Sep 23 03:13:36.288684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:36 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:36.336857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.343983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a2974443-a2b1-4f56-b2ca-10825eaeea2d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.144770 Sep 23 03:13:36.344577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:36 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:36.358816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:36.359353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:36.365302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.367126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.367126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.367126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.487427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.495268 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.496803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.497891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2b0da589-8e85-4b32-85f3-4c2fb4788f16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.142778 Sep 23 03:13:36.498442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 76/151] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:36 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:36.739465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:36.740069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:36.746719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.747134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.747880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:36.748304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:36.888657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:36.895809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-edee294f-858f-4706-913c-da403f4b0658 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.160118 Sep 23 03:13:36.896368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:36 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:37.305397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:37.306001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:37.311679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.312097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.312861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.313288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.361237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:37.361896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:37.368366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.368878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.369631 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.370054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.443158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:37.450567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-55499b1a-174d-4bb4-9805-e96be875cc35 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.149508 Sep 23 03:13:37.451140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:37 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:37.515062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:37.515667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:37.521523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.521967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.522726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.523211 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.535292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:37.543164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-32f973dd-88f6-4a79-a6b7-3446c2a027c5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.185845 Sep 23 03:13:37.543916 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:37 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:37.644099 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:37.651709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:37.653253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:37.654381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-59c828d6-19b3-4fad-9dcd-f04bb9e01c89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.143149 Sep 23 03:13:37.655181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 78/155] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:37 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:37.913750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:37.915688 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:37.920805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.921276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:37.922070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:37.922497 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.054438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.061744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a0941119-95ff-4bcc-afc6-3afd02cf91f0 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.152431 Sep 23 03:13:38.062325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:37 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:38.467056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:38.467656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:38.473351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.473785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.474526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.474944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.561230 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:38.562388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:38.571592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.572030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.572827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.573419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.623079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.631106 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1ac53e2d-3841-4e58-a734-70d12b267a55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.167636 Sep 23 03:13:38.632234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:38 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:38.673827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:38.674992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:38.683115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.684004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.690470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:38.690470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:38.762946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.771181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8cce5136-3f62-495e-aed0-2daa9dd73257 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.214198 Sep 23 03:13:38.771931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 79/158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:38 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:38.875600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.883883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.885413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:38.886502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4e610ecb-91a3-49c4-ba4c-473140bfda06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.217227 Sep 23 03:13:38.887270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 80/159] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:38 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:39.081156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:39.083996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:39.092360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.092864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.093775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.094198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.216343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:39.223665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c47371a0-ad06-4069-a5ab-ceeabbd0bd37 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.148232 Sep 23 03:13:39.224924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:39 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:39.651037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:39.651638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:39.657651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.658090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.658845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.659265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.784753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:39.786910 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:39.787520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:39.792246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-13aa4dac-b7b7-4d69-8920-cf2d9d9000d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.144760 Sep 23 03:13:39.801745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 81/161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:39 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:39.801905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.801905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.801905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.801905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.904766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:39.905630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:39.911433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.911836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.912634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:39.913220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:39.937181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:39.945504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7d5613bc-86eb-499d-a5e2-d7e6d1ad6ada tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.161559 Sep 23 03:13:39.952508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:39 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:40.038627 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:40.047200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:40.048860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:40.049877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7aee01d8-f72e-46e4-ae45-cc706c0a9bdc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.149035 Sep 23 03:13:40.050436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 82/163] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:39 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:40.240369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:40.241077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:40.247299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.247657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:40.248405 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.249003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:40.383213 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:40.396058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-55892c77-18a1-4f09-9e1a-d70175dc5085 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.159272 Sep 23 03:13:40.396800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 82/164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:40 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:40.825303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:40.826370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:40.834548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.835143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:40.836374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.836996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:40.962708 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:40.963433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:40.972292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.975164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:40.979843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:40.979843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:41.004469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.013622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-820d437c-179f-42e1-8a0a-493d67c97b10 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.207701 Sep 23 03:13:41.024312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:40 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:41.070569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:41.071342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:41.079848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:41.080249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:41.081536 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:41.082150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:41.157005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.165170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f3299793-b822-4081-8fb2-339be4d1c55d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.206622 Sep 23 03:13:41.174442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:40 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:41.235872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.244138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.249150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.249150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37d9dd72-cd30-44e7-840f-46ffcd91bba8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.183112 Sep 23 03:13:41.249150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 84/167] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:41 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:41.414364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:41.414964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:41.421233 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:41.421667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:41.422419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:41.422839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:41.570687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:41.579496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-050bafaa-8be0-4573-8a69-6b3bc3169946 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.168052 Sep 23 03:13:41.579496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:41 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:42.030048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:42.030719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:42.036364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.036841 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.037587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.038012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.163149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.170460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-817c23ce-48d8-4b89-a0cb-7e907d3aa21c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.143986 Sep 23 03:13:42.171116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:42 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:42.184460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:42.184460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:42.189467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.190087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.191052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.191549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.265175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:42.266383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:42.274354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.274881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.275701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.276284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.327466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.337217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc91474a-3a07-4509-9340-1f79dece0d28 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.159262 Sep 23 03:13:42.337895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:42 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:42.406706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.414561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.416031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.417146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5297e3a7-494c-478c-be16-2bd2f0f03e92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.156530 Sep 23 03:13:42.417710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 86/171] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:42 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:42.594427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:42.594967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:42.600815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.601280 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.602032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:42.602463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:42.729432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:42.737138 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ebe5b7ec-e9c1-4962-b961-ecd2f6097b12 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.146402 Sep 23 03:13:42.737868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 86/172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:42 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:43.192684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:43.193463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:43.199980 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.200564 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.201405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.201848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.353920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:43.354702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:43.364746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.364746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.364746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.364746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.366091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.373566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-36461532-b6b5-4e60-9ca3-39f4e9fecc74 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.184441 Sep 23 03:13:43.374448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:43 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:43.435070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:43.435869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:43.441615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.442051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.442808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.443232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.495070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.502418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-75ecf76b-439b-41e6-9fab-75103f50b334 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.152306 Sep 23 03:13:43.502983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:43 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:43.617636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.626107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.627589 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.628902 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-61f5d354-0943-46f6-80ca-fe9e6c2c3173 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.197429 Sep 23 03:13:43.629622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 88/175] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:43 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:43.753852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:43.754456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:43.761713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.762338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.763344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:43.763914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:43.894651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:43.902612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fda7db13-b7a4-4ade-8066-063e7b8ab8d2 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.152280 Sep 23 03:13:43.903302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 88/176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:43 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:44.394205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:44.395823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:44.403028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.405884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.405884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.405884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.518844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:44.520059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:44.526613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.527248 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.528204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.528799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.538214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:44.545602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-44c71044-5e65-4efb-bfe5-82bda9a11bbb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.157763 Sep 23 03:13:44.546254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 89/177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:44 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:44.647358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:44.647946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:44.653728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.654399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.655033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.655449 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.697426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:44.705524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-32528287-3a0b-4bc5-9b60-11aa2d8ac7cb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.190341 Sep 23 03:13:44.706437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:44 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:44.834987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:44.843028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:44.844528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:44.845602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e8c04b5c-ac53-4ae3-a811-b2c66a31ea8e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.202047 Sep 23 03:13:44.846154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 90/179] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:44 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:44.919373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:44.920026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:44.925792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.926221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:44.926958 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:44.927376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.050257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:45.057490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-98ec774b-79a5-481c-af8c-04885a12bb13 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.141848 Sep 23 03:13:45.058055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 90/180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:44 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:45.564420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:45.565089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:45.571517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.571950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.572720 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.573143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.692426 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:45.699508 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fbbc992a-37ac-47fb-9667-679b3f70fa9d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.138777 Sep 23 03:13:45.700096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:45 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:45.721950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:45.722532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:45.728945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.729328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.730070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.730489 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.854645 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:45.862075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6ba5d620-acce-4047-9aa1-f4be7b88b332 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.143728 Sep 23 03:13:45.862786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 91/182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:45 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:45.863200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:45.863903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:45.869790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.870281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.871017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:45.871436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:45.990326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:45.998724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:46.000290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:46.001346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6881b506-76fd-4580-888f-5faf7da8cde9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.142163 Sep 23 03:13:46.001894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 92/183] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:45 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:46.074636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:46.075247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:46.081127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.081567 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:46.082314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.082739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:46.200450 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:46.207634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-17d72c82-7726-495b-aa70-13fc89d36a04 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.136808 Sep 23 03:13:46.208289 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:46 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:46.716726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:46.717454 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:46.723911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.724245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:46.725022 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.725445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:46.852321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:46.859879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e1ff9d95-7118-415e-8e8a-f2bbebee07c8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.147085 Sep 23 03:13:46.864545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:46 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:46.878769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:46.879368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:46.885605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.886032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:46.886770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:46.887188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.004278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:47.012407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-849d5641-2e4e-4a31-aa87-af43dc76c2a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.137337 Sep 23 03:13:47.014447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 93/186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:46 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:47.019074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:47.019813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:47.025438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.025872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.026652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.027077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.152528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:47.160165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:47.161701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:47.162782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-748046c4-ef29-4aa2-9720-a4b993a07a0d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.147447 Sep 23 03:13:47.163830 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 94/187] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:47 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:47.224556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:47.225096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:47.231335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.231781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.232556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.232985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.352316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:47.359838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2ec58c54-72f6-4bea-b55b-a3ccf394fbe7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.138673 Sep 23 03:13:47.360387 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 94/188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:47 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:47.877063 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:47.877673 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:47.883339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.883773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:47.884540 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:47.884975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.000351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.008013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2b894fb7-4cf9-44b3-9b0e-04e87bb09b8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.134523 Sep 23 03:13:48.008655 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 95/189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:47 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:48.030383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:48.030985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:48.036695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.037141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.037895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.038322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.158677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.165907 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-525b089e-987c-4d57-885e-1f82658d8579 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.139166 Sep 23 03:13:48.166469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 95/190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:48 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:48.180637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:48.181245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:48.186991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.187434 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.188191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.188649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.375996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:48.376528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:48.383162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.383595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.384357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:48.384817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:48.465805 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.473731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.475254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.476386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ec1056ae-e428-426d-a1ed-7ffb9340cc1d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.299626 Sep 23 03:13:48.477315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 96/191] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:48 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:48.510008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:48.517153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-470bfcc6-9e14-4899-9cca-fe16d07e907d tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.145054 Sep 23 03:13:48.517714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 96/192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:48 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:49.023726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:49.024328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:49.030305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.030749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.031503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.031958 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.149364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.156377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-eb9d1cb1-2fd4-4e0b-ab90-830d94a7d794 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.136793 Sep 23 03:13:49.156962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 97/193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:49 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:49.182818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:49.183419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:49.189053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.189480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.190219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.190637 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.308725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.315700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5a7bd819-72c6-4173-8645-0d87bd3c41df tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.137045 Sep 23 03:13:49.316253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 97/194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:49 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:49.494902 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:49.495495 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:49.501164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.501601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.502339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.502758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.533619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:49.534264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:49.540541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.540988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.541740 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:49.542161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:49.620016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.627833 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.629354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.630440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d73fb33-f284-45bb-ba52-3e5a94f788ed tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.139998 Sep 23 03:13:49.634425 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 98/195] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:49 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:49.665574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:49.675321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-346a3acc-f2e3-423a-8688-c5d0b688f82b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.142856 Sep 23 03:13:49.675321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 98/196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:49 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:50.172226 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:50.172884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:50.178914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.179346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.180096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.180534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.301290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.309101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-65bd5695-fe14-4156-8b35-26773d9e564f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.140587 Sep 23 03:13:50.309744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:50 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:50.332775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:50.333378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:50.339296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.339736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.340482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.340933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.459386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.466571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ba771733-a061-4023-b2e5-13ebaecf845e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.137574 Sep 23 03:13:50.467128 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 99/198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:50 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:50.650189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:50.650798 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:50.656955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.657397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.658158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.658635 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.690303 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:50.690907 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:50.697729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.698395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.699164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:50.699619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:50.793935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.807640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.809292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.810472 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2c167d12-76ea-4473-9074-326d2b8bcb59 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.164114 Sep 23 03:13:50.811280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 100/199] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:50 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:50.861449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:50.868667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9df66246-f153-4d5d-8860-75d5c5ba3ee6 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.182082 Sep 23 03:13:50.869226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 100/200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:50 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:51.326220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:51.326818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:51.332534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.332980 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.333745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.334175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.459824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:51.467645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f3cbe4fd-b041-4045-9419-157d6684311c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.144918 Sep 23 03:13:51.468705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 101/201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:51 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:51.485174 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:51.485806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:51.492274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.492748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.493494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.493918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.617992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:51.626117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a1fc7f4e-02e8-4db4-bf9c-cd1730e7769d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.146449 Sep 23 03:13:51.626686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 101/202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:51 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:51.837885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:51.838496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:51.853347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.853827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.854623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.855221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.885763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:51.886604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:51.892654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.893173 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:51.894129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:51.894785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.001784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.010081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.011651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.012773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1230249f-2538-43f3-8dad-7968e06e87c7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.182621 Sep 23 03:13:52.013339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 102/203] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:51 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:52.034181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.042276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7f814554-d1ea-4333-8cd6-a6f84d85426a tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.160841 Sep 23 03:13:52.042922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:51 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:52.077390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1c52cd98-ab6e-4c51-ab41-69703e9d8cae req-83a68341-9e31-4fcb-8eae-80edcca24b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565f86c9-78ca-4856-9083-6ed4db043086", "name": "network-vif-plugged", "status": "completed", "tag": "c5c1a228-41bc-4fd1-9c8e-6b4d92214b55"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:13:52.079010 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:13:52.079010 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:13:52.086197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1c52cd98-ab6e-4c51-ab41-69703e9d8cae req-83a68341-9e31-4fcb-8eae-80edcca24b11 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:52.086631 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1c52cd98-ab6e-4c51-ab41-69703e9d8cae req-83a68341-9e31-4fcb-8eae-80edcca24b11 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.097109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1c52cd98-ab6e-4c51-ab41-69703e9d8cae req-83a68341-9e31-4fcb-8eae-80edcca24b11 service nova] Creating event network-vif-plugged:c5c1a228-41bc-4fd1-9c8e-6b4d92214b55 for instance 565f86c9-78ca-4856-9083-6ed4db043086 on hv-cinder-76845 Sep 23 03:13:52.102767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1c52cd98-ab6e-4c51-ab41-69703e9d8cae req-83a68341-9e31-4fcb-8eae-80edcca24b11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088325 Sep 23 03:13:52.103337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 103/205] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:13:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:13:52.486648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:52.487408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:52.493628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:52.494414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.495496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:52.495993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.630165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.639618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4ac655ad-f555-48e6-b3e2-3358d38d3d87 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.157004 Sep 23 03:13:52.640370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 103/206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:52 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:52.642265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:52.643301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:52.649711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:52.650089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.650843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:52.651267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:52.848091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:52.855786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fb5edc21-c84c-4d5f-aea1-eec27652b878 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.217142 Sep 23 03:13:52.856552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 104/207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:52 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:53.030811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:53.031416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:53.038748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.039369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.040129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.040585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.059317 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:53.060193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:53.066248 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.066695 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.067460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.067890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.191894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:53.201547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:53.204574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:53.212256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f2aedefd-cb2a-4e58-8326-d8cb303b018b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.157017 Sep 23 03:13:53.212831 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 105/208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:53 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:53.214494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:53.215795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6dd6151a-17a8-46a5-bac3-4d6e71f9d727 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.188861 Sep 23 03:13:53.216334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 104/209] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:53 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:53.656517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:53.657128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:53.663743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.664272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.665069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.665498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.786991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:53.795654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6c62d50d-8d9a-46ae-b72f-025802183dfb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.142827 Sep 23 03:13:53.796223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:53 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:53.872347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:53.872989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:53.878956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.879395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:53.880146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:53.880609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.000663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.008391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4082dee0-c7c9-496a-bfb2-9c8d45adfcc7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.139643 Sep 23 03:13:54.026165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:53 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:54.228431 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:54.229201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:54.239217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:54.241076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.242229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.243252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.243696 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.245850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:54.254057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.254447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.255219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.255648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.374294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.381915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-726b178b-5dc9-4654-b5d6-5d4395b00f7c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.157232 Sep 23 03:13:54.382480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 107/212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:54 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:54.390614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.399242 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.401020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.402381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c753d8f0-6852-4846-aee3-0e0b2a5b9354 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.166950 Sep 23 03:13:54.403099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 106/213] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:54 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:13:54.822754 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:54.823438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:54.829197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.829636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.830385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:54.830844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:54.954689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:54.962180 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ae79fad8-c619-43c2-b87f-313f72fcc3e4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.147607 Sep 23 03:13:54.962749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 108/214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:54 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:55.040458 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:55.041087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:55.046798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.047234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.047981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.048404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.165891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:55.173156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8a631af3-6b9f-440d-b800-43abd59b13b2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.136465 Sep 23 03:13:55.173715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 107/215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:55 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:55.398575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:55.399184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:55.404875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.405318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.406072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.406502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.420029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:55.420593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:55.426190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.426626 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.427373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.427797 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.528881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:55.536749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-41da08f4-a47f-419f-8afb-f6db2e94580c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.141812 Sep 23 03:13:55.537331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 109/216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:55 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:55.545122 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:55.552918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:55.554495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:55.555573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8eaccc50-15b9-4b09-8653-ac67c5b68df9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.139283 Sep 23 03:13:55.556168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 108/217] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:55 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:55.979505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:55.980209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:55.986159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.986589 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:55.987325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:55.987749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.105337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.112775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-302ed8ae-9fa2-4fa9-8ab2-de4e98f0800d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.137546 Sep 23 03:13:56.113346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 110/218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:55 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:56.189994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:56.190597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:56.196238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.196717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.197467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.197889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.320293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.327568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f16eb86e-349a-4820-ba50-f2af3afa292a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.141119 Sep 23 03:13:56.328156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 109/219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:56 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:56.553670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:56.554277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:56.560247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.560724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.561479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.561907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.574850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:56.575437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:56.581030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.581471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.582211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:56.582633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:56.683811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.692112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d2bbeeb7-8e17-4619-ba8d-b3f42252398e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.142121 Sep 23 03:13:56.693301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 111/220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:56 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:56.707536 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.719576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.721135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:56.722220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-377e067a-fdf4-424f-8dad-b8e6ede31867 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.151046 Sep 23 03:13:56.722889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 110/221] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:56 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:57.129559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:57.130162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:57.136365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.138438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.138438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.138438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.258339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.265640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-874613e2-5f84-4281-a89a-4c39bf9ad29c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.139835 Sep 23 03:13:57.266201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:57 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:57.344086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:57.344683 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:57.350468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.350915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.351661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.352089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.467011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.474051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5e026bb5-b763-459e-9181-be006f62caa1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.133681 Sep 23 03:13:57.474635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 111/223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:57 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:57.709503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:57.710572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:57.715971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.716447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.717258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.717678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.740694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:57.741914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:57.747948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.748754 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.749660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:57.750078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:57.839368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.846670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c22ed95b-4be8-48e6-b8c3-de2e8979410c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.140727 Sep 23 03:13:57.847240 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 113/224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:57 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:57.872478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.880008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.881682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:57.882749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e9b74ef0-ee0f-44a1-9a76-0f292751256a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.145720 Sep 23 03:13:57.883290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 112/225] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:57 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:58.282065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:58.282691 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:58.288455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.288921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.289666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.290090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.405496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:58.413278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8384e474-530c-4669-8264-3af935057769 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.134468 Sep 23 03:13:58.413889 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 114/226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:58 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:58.490628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:58.491793 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:58.497520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.497960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.498704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.499127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.614236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:58.621729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-603c9c85-ca7e-45a1-b081-79b1baba74ae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.134696 Sep 23 03:13:58.622290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 113/227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:58 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:58.863923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:58.864471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:58.871627 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.872069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.872848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.873273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.900607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:58.901208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:58.906998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.907440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.908193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:58.908659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:58.997283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.004512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ffe5b66c-d902-4f63-a4ae-4e6bf17ce2cb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.144224 Sep 23 03:13:59.005074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:58 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:13:59.028750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.036513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.038585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.039661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5592a013-41ec-424f-a2aa-295b77bf390f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.143229 Sep 23 03:13:59.040216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 114/229] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:13:58 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:13:59.429984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:59.430670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:59.436376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:59.436857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:59.437602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:59.438026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:59.554551 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.561656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-22a444bb-73cf-4bf2-acbb-8eaec6157f91 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.135922 Sep 23 03:13:59.562200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 116/230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:59 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:13:59.638440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:13:59.639048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:13:59.644847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:59.645286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:59.646040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:13:59.646467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:13:59.767482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:13:59.775276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-59f1913b-9635-42a0-a06c-2e7f4f965db9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.140463 Sep 23 03:13:59.775934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 115/231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:13:59 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:00.021065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:00.021702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:00.028056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.028835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.029743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.029743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.057845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:00.058599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:00.065708 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.066202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.067047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.067541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.167744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.175071 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b64704e3-2825-4a65-bc27-676cf7eda49b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.157763 Sep 23 03:14:00.175637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 117/232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:00 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:00.189418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.197174 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.198639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.199707 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d8d1207b-29e9-4977-9637-e8a6c14a35d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.145935 Sep 23 03:14:00.200249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 116/233] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:00 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:00.577937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:00.578571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:00.584326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.585366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.586116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.586587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.706759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.714642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c4b0e1fe-4c0c-45ae-8040-75afe1742d53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.140326 Sep 23 03:14:00.715205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 118/234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:00 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:00.791614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:00.792745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:00.798992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.799534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.800394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:00.800915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:00.933383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:00.940477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-eb47ed7d-dbba-455a-b23e-9e729d95cb08 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.152526 Sep 23 03:14:00.941049 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 117/235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:00 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:01.105050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-f4d1e702-7dcb-4176-a03d-ebf810177504 req-76e96461-d46c-4f67-80a1-d789955ee0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4135490e-a5b9-4f7f-b01b-60d0a6bf7d17", "name": "network-vif-plugged", "status": "completed", "tag": "fe931329-5d49-473e-b438-0f6e1c7ff098"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:01.106672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:01.106672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:14:01.113586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f4d1e702-7dcb-4176-a03d-ebf810177504 req-76e96461-d46c-4f67-80a1-d789955ee0fd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.114024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f4d1e702-7dcb-4176-a03d-ebf810177504 req-76e96461-d46c-4f67-80a1-d789955ee0fd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.125107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-f4d1e702-7dcb-4176-a03d-ebf810177504 req-76e96461-d46c-4f67-80a1-d789955ee0fd service nova] Creating event network-vif-plugged:fe931329-5d49-473e-b438-0f6e1c7ff098 for instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 on hv-cinder-76845 Sep 23 03:14:01.130138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-f4d1e702-7dcb-4176-a03d-ebf810177504 req-76e96461-d46c-4f67-80a1-d789955ee0fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028744 Sep 23 03:14:01.130708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 119/236] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:01.245756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:01.246155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:01.246399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:01.246847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:01.252134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.252604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.252753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.253197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.253346 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.253767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.253950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.254381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.390585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:01.396004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:01.398924 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:01.400413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:01.401528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e6f66744-39af-4ae0-b95e-128783406843 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.159284 Sep 23 03:14:01.402096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 120/237] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:01 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:01.404179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-60591237-1047-4a58-b095-8d6cf31c128f tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.162235 Sep 23 03:14:01.404764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 118/238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:01 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:01.730794 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:01.731391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:01.737584 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.738024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.738768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.739292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.876659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:01.883775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5c08818b-5a63-4710-a262-48a5c40fd194 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.156600 Sep 23 03:14:01.884333 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 121/239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:01 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:01.956418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:01.957059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:01.963394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.963833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:01.964602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:01.965030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.079069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:02.086717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0e14a034-0195-4a69-bd0f-4da516af01cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.133852 Sep 23 03:14:02.087278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 119/240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:01 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:02.419582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:02.420320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:02.420438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:02.420980 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:02.426319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.426564 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.426763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.427018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.427519 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.427753 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.427948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.428199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.553136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:02.553602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:02.560457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34233f52-41c6-4fbd-85b1-34eb0714b3ab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.143704 Sep 23 03:14:02.561123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 120/241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:02 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:02.561255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:02.562719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:02.563818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8a8af8ad-82bf-49b6-b798-9d6a73fe71af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.148067 Sep 23 03:14:02.564360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 122/242] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:02 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:02.900287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:02.900665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:02.906383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.906823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:02.907550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:02.907971 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.029438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.036838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-94e8cdc0-2e06-4809-a398-f5ec076d0454 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.140410 Sep 23 03:14:03.037414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 121/243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:02 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:03.102967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:03.103537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:03.109511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.109948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.110692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.111118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.145012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-5c729e5f-0df0-4eaf-9f39-fabe0204fc7d req-7fc61877-a9f2-4a09-9b6c-a11707fdd41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "name": "network-vif-plugged", "status": "completed", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:03.146728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:03.146728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:14:03.154206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-5c729e5f-0df0-4eaf-9f39-fabe0204fc7d req-7fc61877-a9f2-4a09-9b6c-a11707fdd41d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.155008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-5c729e5f-0df0-4eaf-9f39-fabe0204fc7d req-7fc61877-a9f2-4a09-9b6c-a11707fdd41d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.165646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-5c729e5f-0df0-4eaf-9f39-fabe0204fc7d req-7fc61877-a9f2-4a09-9b6c-a11707fdd41d service nova] Creating event network-vif-plugged:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:14:03.170803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-5c729e5f-0df0-4eaf-9f39-fabe0204fc7d req-7fc61877-a9f2-4a09-9b6c-a11707fdd41d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029403 Sep 23 03:14:03.171384 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 122/244] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:14:03.228902 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.236200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4024a7ee-739c-4e22-8398-eb371570f276 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.136931 Sep 23 03:14:03.236823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:03 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:03.577920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:03.578598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:03.580835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:03.581471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:03.584679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.585116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.585858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.586279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.587105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.587544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.588293 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:03.588741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:03.708448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.708593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.712215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-587adb93-0324-4d90-86b4-c847831515f8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.138479 Sep 23 03:14:03.712813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 123/246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:03 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:03.714528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.716030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:03.717145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f5eaf765-c720-4737-ab12-94e25077df7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.139966 Sep 23 03:14:03.717692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 124/247] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:03 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:04.053400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:04.054002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:04.059726 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.060934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.060934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.061318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.183402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.190528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b1042e66-6902-4f5f-9c91-b2a1d0b83497 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.140870 Sep 23 03:14:04.191094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 124/248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:04 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:04.256377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:04.257032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:04.263068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.263516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.264280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.265371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.432015 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.439233 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5b2600f4-83b2-4613-b935-1b1f67232133 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.189738 Sep 23 03:14:04.439785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 125/249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:04 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:04.729199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:04.729721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:04.734990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:04.735694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:04.735803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.736146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.736937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.737368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.742669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.742669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.747084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:04.747084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:04.863694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.864048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.871575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cccc8e6c-b265-4256-a636-db6587cd7cab tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.146265 Sep 23 03:14:04.872126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 125/250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:04 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:04.875083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.875083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:04.875083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-967c5cde-e536-49be-8342-09400f683061 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.143692 Sep 23 03:14:04.875385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 126/251] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:04 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:05.206911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:05.207533 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:05.213778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.214208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.214945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.215362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.330855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:05.338311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-038e3341-8653-4ff4-95cf-023d49379c7f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.134952 Sep 23 03:14:05.338895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 126/252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:05 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:05.455341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:05.455945 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:05.461660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.462095 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.462836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.463261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.582499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:05.590084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8b127e4f-4ee6-4a26-9957-a8bc37d64f88 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.138346 Sep 23 03:14:05.590652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 127/253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:05 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:05.888812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:05.889433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:05.891834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:05.892527 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:05.895236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.895662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.896404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.896896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.898857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.899298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:05.900056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:05.900465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.020995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.025114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.029760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-29e127e9-9cf6-4207-8cf5-1d449ef07524 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.144575 Sep 23 03:14:06.037874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 127/254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:05 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:06.043178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.044912 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.046007 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f436395a-8ef8-4641-b411-e9d31802f647 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.157931 Sep 23 03:14:06.046592 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 128/255] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:05 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:06.354559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:06.355158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:06.361146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:06.361587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.362334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:06.362762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.486520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.494286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a5c90fc4-37c0-4651-a732-79f113af6163 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.143312 Sep 23 03:14:06.494850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 128/256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:06 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:06.606678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:06.607283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:06.613330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:06.613767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.614517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:06.614948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.731641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:06.776680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7e2b0c06-c0e7-4199-aec1-0919c37ac112 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.173494 Sep 23 03:14:06.780617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:06 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:06.911574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-349591d6-40d3-4707-8578-08efb327e6be req-b94a1489-5336-493f-91d7-601b3cfb509c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3e7808-544d-464f-a759-648393c4f9b8", "name": "network-vif-plugged", "status": "completed", "tag": "91d8a60b-64c2-40d5-b3f2-d768b237086a"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:06.913690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:06.913690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:14:06.920691 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-349591d6-40d3-4707-8578-08efb327e6be req-b94a1489-5336-493f-91d7-601b3cfb509c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:06.921125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-349591d6-40d3-4707-8578-08efb327e6be req-b94a1489-5336-493f-91d7-601b3cfb509c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:06.932115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-349591d6-40d3-4707-8578-08efb327e6be req-b94a1489-5336-493f-91d7-601b3cfb509c service nova] Creating event network-vif-plugged:91d8a60b-64c2-40d5-b3f2-d768b237086a for instance 2f3e7808-544d-464f-a759-648393c4f9b8 on hv-cinder-76845 Sep 23 03:14:06.937015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-349591d6-40d3-4707-8578-08efb327e6be req-b94a1489-5336-493f-91d7-601b3cfb509c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029201 Sep 23 03:14:06.937592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 129/258] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:07.049188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:07.049914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:07.056401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.056925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.059009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.063640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:07.064856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.065320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:07.076444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.076912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.077664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.078086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.205500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:07.216146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:07.221153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f377c13b-651f-4baa-acf5-d8085bc78211 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.175986 Sep 23 03:14:07.221876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 130/259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:07 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:07.224759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:07.226828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:07.227943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4d5da230-d9ee-405f-a453-34e97077169b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.168622 Sep 23 03:14:07.235486 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 130/260] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:07 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:07.511254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:07.511781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:07.517651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.518080 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.518814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.519230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.636354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:07.643590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5000ed79-cfa0-439c-a9e8-0a673384703a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.136030 Sep 23 03:14:07.644180 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 131/261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:07 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:07.793563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:07.794170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:07.799981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.800422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:07.801208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:07.801633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.066290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.073921 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1886c55c-041d-4bfa-b59e-44e4b3c7e6e8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.284013 Sep 23 03:14:08.074486 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 131/262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:07 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:08.238542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:08.239144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:08.245772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.246215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.246398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:08.247044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:08.247174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.247470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.252961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.253406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.254159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.254590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.366058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.370667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.373258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f96a47f0-83f6-4b21-b2d0-58eafc1f1ff4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.138361 Sep 23 03:14:08.373835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 132/263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:08 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:08.378220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.379697 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.380802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2e475dc5-f77e-42d5-adce-03310b2bb29c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.138113 Sep 23 03:14:08.381888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 132/264] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:08 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:08.659602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:08.660136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:08.666509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.666948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.667699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.668123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.790705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:08.797837 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bd7bd1a9-904b-451e-82f1-fdc6cadbd46e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.142082 Sep 23 03:14:08.798401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:08 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:08.952032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-b8088e9d-2b44-46d7-a0dc-202621170335 req-a9b960e6-b5f7-4093-b7cb-680501c77315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ba4276-abfb-4947-920f-a0cc8dffab54", "name": "network-vif-plugged", "status": "completed", "tag": "a49c2a6f-b48c-430a-a827-5f061c7c60c2"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:08.953629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:08.953629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:14:08.960904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b8088e9d-2b44-46d7-a0dc-202621170335 req-a9b960e6-b5f7-4093-b7cb-680501c77315 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:08.961331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b8088e9d-2b44-46d7-a0dc-202621170335 req-a9b960e6-b5f7-4093-b7cb-680501c77315 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:08.971611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-b8088e9d-2b44-46d7-a0dc-202621170335 req-a9b960e6-b5f7-4093-b7cb-680501c77315 service nova] Creating event network-vif-plugged:a49c2a6f-b48c-430a-a827-5f061c7c60c2 for instance 97ba4276-abfb-4947-920f-a0cc8dffab54 on hv-cinder-76845 Sep 23 03:14:08.976791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-b8088e9d-2b44-46d7-a0dc-202621170335 req-a9b960e6-b5f7-4093-b7cb-680501c77315 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028347 Sep 23 03:14:08.977341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 133/266] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:09.090697 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:09.091299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:09.096997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.097440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.098187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.098613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.222021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.229175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f5e747db-9356-48ce-b25c-9c2e986cd5c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.142067 Sep 23 03:14:09.229739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 134/267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:09 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:09.390350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:09.391179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:09.397226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.397671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.398432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.398700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:09.398866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.399325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:09.405147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.405579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.406319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.406738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.531075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.536223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.538546 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5f30b137-9f6b-47e0-af76-cb5df2339d31 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.152096 Sep 23 03:14:09.539123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 134/268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:09 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:09.544075 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.545788 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.546928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-792b348c-e584-4f6c-b010-3c1f6ecd075d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.151864 Sep 23 03:14:09.547544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 135/269] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:09 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:09.814408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:09.814999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:09.820996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.821429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.822266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:09.822573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:09.937033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:09.944041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aec888a1-f42a-45d9-92ae-8a4bbd6d91c7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1317 microversion: 2.1 time: 0.133325 Sep 23 03:14:09.944618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 135/270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:09 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1317 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:10.245982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:10.246926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:10.253145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.253658 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.254483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.254967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.393862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:10.401572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-54c5b09d-2f74-4322-8ebb-aed905df5fa4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.159652 Sep 23 03:14:10.402135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 136/271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:10 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:10.555036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:10.555670 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:10.561552 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.561994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.562743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.563168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.564995 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:10.565630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:10.571727 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.572195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.572975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.573405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.687611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:10.691323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:10.695590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-64487411-8cc1-4301-973b-2516cc72e6e4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.144234 Sep 23 03:14:10.696156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 136/272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:10 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:10.699568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:10.701117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:10.702202 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bfbb8aeb-492b-4fef-b598-594acbe11265 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.140976 Sep 23 03:14:10.702742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 137/273] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:10.961601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:10.962201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:10.968176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.968867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:10.969667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:10.970100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.087035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.094789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b20712f3-2d0f-4243-9ee2-80010b4a1621 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1506 microversion: 2.1 time: 0.137682 Sep 23 03:14:11.097775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 137/274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:10 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1506 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:11.418467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:11.419103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:11.424820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.425255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.425995 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.426412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.550677 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.558972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c4ced0cc-1fee-4dd1-a4ea-7f19e636422b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.144187 Sep 23 03:14:11.559546 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 138/275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:11 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:11.713357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:11.714232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:11.718838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:11.719432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:11.720262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.720872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.721758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.722625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.730154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.730154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.730154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:11.730154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:11.876357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.880203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.884439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.885982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:11.887072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-01f262ab-efef-452d-94dd-831b149f4d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.171953 Sep 23 03:14:11.887537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9b068191-d22f-4c9c-9144-7094bf072164 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.179181 Sep 23 03:14:11.888108 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 138/276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:11 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:11.888409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 139/277] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:11 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:12.575413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:12.576016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:12.581674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.582110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:12.582844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.583261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:12.713459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:12.721013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-60d6a838-e50d-41d3-bfa9-8000d8269843 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.149205 Sep 23 03:14:12.721635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 139/278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:12 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:12.904454 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:12.905209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:12.905674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:12.906380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:12.910933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.911333 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:12.912585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.912962 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.913074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:12.913890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:12.914959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:12.926534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:13.035920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:13.055411 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:13.055561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5639432d-a9d0-4325-8cf4-b7a5bf1e6d4b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.142496 Sep 23 03:14:13.055561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 140/279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:12 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:13.055731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:13.055731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:13.055731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a856a752-7789-4573-85d0-3ebfc62c0a80 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.149704 Sep 23 03:14:13.055978 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 140/280] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:12 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:13.738928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:13.739533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:13.745771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:13.746212 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:13.746964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:13.747391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:13.863963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:13.871075 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cae337b5-69d9-4426-8c19-ab11f62ffc67 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.135741 Sep 23 03:14:13.871639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 141/281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:13 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:14.069965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:14.070628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:14.072250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:14.072872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:14.076526 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.076963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:14.077720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.078124 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:14.078428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.078862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:14.079600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.080055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:14.200702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:14.203320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:14.207917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9cf6a74c-25cb-4c3b-896b-761bcf41a6ea tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.141659 Sep 23 03:14:14.208483 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 141/282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:14 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:14.211351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:14.213084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:14.214232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-44addd80-965f-436a-9304-0dee76a39903 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.145501 Sep 23 03:14:14.214768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 142/283] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:14 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:14.887485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:14.888079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:14.893848 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.894280 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:14.895015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:14.895435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:15.010857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:15.017936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-101f4421-c0e3-4ffc-8b4a-4715f739c700 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.134063 Sep 23 03:14:15.018499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 142/284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:14 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:15.224332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:15.224897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:15.230674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:15.231105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:15.231275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:15.231424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:15.232167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:15.232616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:15.237210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:15.237656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:15.238408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:15.238830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:15.354356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:15.356179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:15.361941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6c498962-4915-4479-9aba-a81747fcb836 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.141280 Sep 23 03:14:15.362507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 143/285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:15 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:15.364288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:15.366370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:15.367480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fbffaa6c-a2a2-483a-9254-4ae1e3ab0289 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.140450 Sep 23 03:14:15.368022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 143/286] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:15 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:16.034889 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:16.035537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:16.041305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.041734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.042472 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.043238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.157765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:16.164749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4af44818-4162-4678-8071-9fde4ff4f643 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.133479 Sep 23 03:14:16.165295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 144/287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:16 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:16.378788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:16.379566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:16.384161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:16.384784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:16.385897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.386337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.387082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.387502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.390326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.390770 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.391511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:16.391935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:16.513603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:16.517152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:16.521516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-029309b5-2c4b-4078-b14c-654012481683 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.146392 Sep 23 03:14:16.522175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 144/288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:16 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:16.524811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:16.526335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:16.527410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-243d5e54-7591-414f-b597-da8178bc9b17 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.146885 Sep 23 03:14:16.527958 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 145/289] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:16 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:14:17.180918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:17.181519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:17.187345 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.187784 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.188557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.188991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.310045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:17.317119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8ce8ffd6-6d89-468d-bae6-7f578ad85b59 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.139883 Sep 23 03:14:17.317678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 145/290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:17 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:17.538471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:17.540598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:17.545203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:17.546103 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:17.547196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.547915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.548763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.549386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.552244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.554729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.554729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:17.554729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:17.677345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:17.678067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:17.685359 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0079de6c-043c-4d53-baea-3c01ab2f9bc1 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1315 microversion: 2.1 time: 0.150741 Sep 23 03:14:17.685946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:17.686072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 146/291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:17 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:17.687477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:17.688586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-58e67bbf-cb36-4b04-9539-b729cc283836 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1407 microversion: 2.20 time: 0.147202 Sep 23 03:14:17.689147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 146/292] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:17 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:18.334842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:18.335458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:18.341137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.341602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.342377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.342802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.459843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:18.467037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3b484c06-5c78-41b4-9399-10335687d7cd tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1322 microversion: 2.1 time: 0.136330 Sep 23 03:14:18.467847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 147/293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:18 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:18.702137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:18.702745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:18.709285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.709608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.714246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.714246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.714480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:18.714480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:18.718078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.718517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.719271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.719715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.845117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:18.852475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-07f45acc-8e4a-45d3-a434-e73447931ce4 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1501 microversion: 2.1 time: 0.154037 Sep 23 03:14:18.853054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 147/294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:18 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:18.863344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:18.868695 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:18.870431 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:18.871583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5edec847-8277-4e45-8825-73e62f96caaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1599 microversion: 2.20 time: 0.164588 Sep 23 03:14:18.872130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 148/295] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:14:18 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:18.890926 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:18.898158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:18.904318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.905251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:18.905687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:18.906118 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:19.023556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-206efed6-a072-4bfe-8809-34aeee4e860a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.136483 Sep 23 03:14:19.024219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 148/296] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Sep 23 03:14:18 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:14:19.485162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:19.486086 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:19.499579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:19.499579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:19.499579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:19.499579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:19.634346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:19.641814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d8489039-7d0a-47eb-a27f-3416629a81c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1516 microversion: 2.1 time: 0.161117 Sep 23 03:14:19.642477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 149/297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:19 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:19.658754 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:19.664441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:19.666127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:19.666571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:19.667591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:19.668525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:19.706347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'flavor' on Instance uuid 2f3e7808-544d-464f-a759-648393c4f9b8 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:14:19.985984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c21b673a-15ef-49a9-be2a-783b9a430e62 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8/action" status: 200 len: 32 microversion: 2.1 time: 0.330768 Sep 23 03:14:19.986764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 149/298] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:14:19 2021] POST /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:14:19.996578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:19.997337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:20.003502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:20.003953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:20.004866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:20.005292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:20.124635 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:20.132387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9c74bfd1-18bb-4f7c-b117-3c89eee43aae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.139920 Sep 23 03:14:20.132897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 150/299] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:19 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:20.390514 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:20.391810 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:20.394534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-0487afd7-d3c8-4564-a14e-f23cd3231780 req-07410950-27c7-46a9-861f-7106f838e14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:20.396522 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:20.396522 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:14:20.398658 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:20.399193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:20.400187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:20.401026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:20.405517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-0487afd7-d3c8-4564-a14e-f23cd3231780 req-07410950-27c7-46a9-861f-7106f838e14c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:20.405955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-0487afd7-d3c8-4564-a14e-f23cd3231780 req-07410950-27c7-46a9-861f-7106f838e14c service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:20.420342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-0487afd7-d3c8-4564-a14e-f23cd3231780 req-07410950-27c7-46a9-861f-7106f838e14c service nova] Creating event network-changed:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:14:20.426276 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-0487afd7-d3c8-4564-a14e-f23cd3231780 req-07410950-27c7-46a9-861f-7106f838e14c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038537 Sep 23 03:14:20.427418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 151/300] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:21.151629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:21.152328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:21.158423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:21.158862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:21.159620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:21.160043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:21.289888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:21.296921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4e9c2dbb-79e8-44b1-baa6-ee0478a21d41 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.151432 Sep 23 03:14:21.297483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 152/301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:21 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:22.313601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:22.314272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:22.320783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:22.321224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:22.321977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:22.322400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:22.437829 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:22.445404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fe9423bc-bb37-47d8-8c33-e58182da71cc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.135447 Sep 23 03:14:22.445954 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 153/302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:22 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:23.462555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:23.463296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:23.468955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:23.469383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:23.470154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:23.470574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:23.560752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-151e4fb7-cfe4-4425-a2c5-18938221f555 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 3.174725 Sep 23 03:14:23.561391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 150/303] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:20 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:23.612368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:23.629241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-69fd00f7-8058-4bf6-be46-ad3700440c65 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.170943 Sep 23 03:14:23.632748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:23 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:24.573803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:24.574781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:24.581847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.582267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:24.583010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.583478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:24.646726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:24.653188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:24.653188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.653597 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:24.654297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.654722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:24.684562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8ac6d945-a899-4ffe-8692-170893500e01 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.115347 Sep 23 03:14:24.685193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 151/305] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:24 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:24.783377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:24.791427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5e01bb26-5eb6-4579-9a7a-c426436364b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.148271 Sep 23 03:14:24.791990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 155/306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:24 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:24.878774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8dd4fab-8d93-4ab0-a556-ca261bb95d2c"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:24.879917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:24.886441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.886884 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:24.887642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:24.888072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:25.642151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aec5fa09-a2fb-4928-9848-d6a452f10203 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767196 Sep 23 03:14:25.642866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 152/307] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:14:24 2021] POST /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:25.697862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:25.698825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:25.704719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:25.705190 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:25.706014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:25.706417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:25.809307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:25.809994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:25.815979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:25.816418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:25.818643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:25.818643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:25.937430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-006d3cd6-2331-491a-bd63-11ebc642c0ae tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.245777 Sep 23 03:14:25.941184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 156/308] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:25 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:25.941932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:25.949565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-12f25d4e-77dd-43dc-a63d-0d31aadebe68 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.144239 Sep 23 03:14:25.950191 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 153/309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:25 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:26.923615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a5e39a6-076c-42d9-a173-b63ea64b6e77"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:26.924784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:26.932476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:26.932946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:26.933701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:26.934129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:26.948790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:26.949808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:26.955964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:26.956400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:26.957183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:26.957659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:27.100826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-93d3eb06-7dd1-49df-a4ed-7ca7b7e8d0c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.155853 Sep 23 03:14:27.101394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 154/310] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:26 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:27.106192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:27.106875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:27.113631 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:27.114076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:27.115450 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:27.115882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:27.237714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:27.245472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3940bc93-a8fc-48fa-a0ac-34e88ac05761 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.142996 Sep 23 03:14:27.246024 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 155/311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:27 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:27.705437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-02fe4c66-c98e-4be8-b914-76a5385f3cfb tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "POST /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785712 Sep 23 03:14:27.706245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 157/312] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:14:26 2021] POST /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:28.111794 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:28.112730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:28.118853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:28.119296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:28.120058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:28.120504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:28.250293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-824cbb5c-adb6-4f76-a839-06918b29e961 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.142351 Sep 23 03:14:28.253464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 156/313] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:28 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:28.262883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:28.263579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:28.272470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:28.273030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:28.273851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:28.275821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:28.400272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:28.407800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a4c6ec09-334a-4c97-bf85-c853244459dc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.149407 Sep 23 03:14:28.408367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 158/314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:28 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:29.261515 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:29.262433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:29.268806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:29.269251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:29.270014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:29.270439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:29.365015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e64f8e02-0f66-4d0c-bd9d-ba6e11a4a208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.107416 Sep 23 03:14:29.365938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 157/315] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:29 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:29.425468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:29.426156 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:29.432467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:29.437084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:29.437084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:29.437084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:29.582998 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:29.590715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bb073bbb-e4d9-437b-b408-78edefee4e2a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.169005 Sep 23 03:14:29.591287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 159/316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:29 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:30.383146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:30.384028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:30.390482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:30.390921 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:30.391679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:30.392112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:30.507123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-97277453-16a3-403c-a196-cba696bda44c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.128602 Sep 23 03:14:30.507935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 158/317] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:30 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:30.606998 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:30.607585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:30.614032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:30.615391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:30.615391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:30.615647 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:30.734191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:30.741385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9a28c4e8-fe33-4eaf-9aab-6b8cbaeab2f4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.137996 Sep 23 03:14:30.741941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 160/318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:30 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:31.518564 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:31.519540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:31.531853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:31.532292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:31.533110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:31.533544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:31.636996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-017da33c-d79d-4a97-b1cf-493996ea0aff tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 14 microversion: 2.20 time: 0.122230 Sep 23 03:14:31.637629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 159/319] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:31 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:31.757824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:31.758427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:31.764120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:31.764513 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:31.765284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:31.765705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:31.932141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:31.944025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b427a5aa-4dc8-4837-91e9-4addb419cad4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.189761 Sep 23 03:14:31.953698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 161/320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:31 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:32.648214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:32.649234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:32.660208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:32.661154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:32.662513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:32.663001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:32.961591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:32.962907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:32.978302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:32.978302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:32.978302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:32.978302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:33.112439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:33.120973 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-163158de-7e44-42b5-9353-07eea02a2ae7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.163627 Sep 23 03:14:33.121549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 162/321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:32 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:34.138432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:34.139138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:34.144932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:34.145950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:34.146801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:34.147292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:34.308855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:34.326976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-36d7c24e-7279-40a4-b2a7-cce2b0b4b8e9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.181621 Sep 23 03:14:34.336252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:34 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:35.345482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:35.346254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:35.352471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:35.352952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:35.353713 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:35.354143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:35.476556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:35.484201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7590cab1-d7af-427a-aa79-5f835be19d77 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.142354 Sep 23 03:14:35.484790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 164/323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:35 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:35.886090 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1d9c3cd5-8cf9-40f4-b981-996c4590ad4b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 8211 microversion: 2.20 time: 3.242302 Sep 23 03:14:35.889612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 160/324] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:32 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 8211 bytes in 3244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:14:36.501033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:36.501640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:36.507377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:36.507821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:36.508795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:36.509228 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:36.628854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:36.636619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3d1c9aa4-345a-465b-b13c-162e5e5f6fd4 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.139352 Sep 23 03:14:36.637185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 165/325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:36 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:36.899307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:36.899307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:36.905537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:36.905980 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:36.906732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:36.907161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:37.029377 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-073ec08c-9fb1-4cff-a689-e56b85b3677f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 15025 microversion: 2.20 time: 0.135449 Sep 23 03:14:37.033008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 161/326] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:36 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 15025 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:37.653385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:37.654048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:37.659847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:37.660291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:37.661582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:37.662013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:37.785572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:37.793978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b4a1bdb5-dee2-410e-8b8c-aae92d24ef83 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.144425 Sep 23 03:14:37.794539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 166/327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:37 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:38.041266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:38.042259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:38.048722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:38.049168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:38.049925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:38.050357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:38.239855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5f4932d1-151a-4ee4-bd56-d1eacf7fe142 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 17665 microversion: 2.20 time: 0.201861 Sep 23 03:14:38.243335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 162/328] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:38 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 17665 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:38.813028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:38.813636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:38.819558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:38.820027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:38.820819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:38.821247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:38.952700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:38.959916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cd284b6b-01b2-4298-aaad-d6dd93db50bc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.150440 Sep 23 03:14:38.960463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 167/329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:38 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:39.251719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:39.252676 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:39.259332 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:39.259769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:39.262203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:39.262667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:39.977078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:39.977679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:39.983666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:39.984098 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:39.984869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:39.985289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:40.100504 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:40.107555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-53e132f2-82bd-4f19-8a07-56881fb346f2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.134734 Sep 23 03:14:40.108376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 168/330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:39 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:41.124123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:41.124782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:41.130896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:41.131492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:41.132686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:41.133124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:41.252690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:41.259916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-71dd3eff-31c7-4b43-b077-0b6b95caf6a0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.139444 Sep 23 03:14:41.260480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 169/331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:41 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:42.276480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:42.277105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:42.282867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:42.283306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:42.284058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:42.284501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:42.403268 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:42.410304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1756dfff-80e7-4eb4-b6a9-c59ecaf7751e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.137436 Sep 23 03:14:42.410856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 170/332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:42 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:43.233313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6064b03a-ed2b-45fc-9a65-dfd63252a7c3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 23203 microversion: 2.20 time: 3.985261 Sep 23 03:14:43.234246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 163/333] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:39 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 23203 bytes in 3988 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:43.425911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:43.426518 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:43.432635 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:43.433084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:43.433835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:43.434297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:43.553427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:43.560617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2080c66b-6bf6-4c0a-97f8-f768b0170928 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.138456 Sep 23 03:14:43.566534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 171/334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:43 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:44.245805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:44.246802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:44.253328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:44.253758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:44.254516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:44.254946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:44.359710 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-94e4da11-d5e8-431a-ae6b-4cc9f935057d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 23803 microversion: 2.20 time: 0.117773 Sep 23 03:14:44.360669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 164/335] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:44 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 23803 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:44.581331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:44.581937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:44.588269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:44.588747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:44.589544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:44.589938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:44.709525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:44.717283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6a392a39-0159-40e6-81de-2314882e5e24 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.139463 Sep 23 03:14:44.717855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 172/336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:44 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:45.129731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247673650", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "803c4c70-2ff9-4ddc-a896-3501f0b2a0a2"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:45.273091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] validate_networks() for [('803c4c70-2ff9-4ddc-a896-3501f0b2a0a2', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:14:45.371173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:45.376651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:45.383440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.383938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.384813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.385301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.495722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d3beef3-2406-48a8-910a-0a01ede39356 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 24982 microversion: 2.20 time: 0.128187 Sep 23 03:14:45.496351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 173/337] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:45 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 24982 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:14:45.636566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:14:45.637177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:14:45.637949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:14:45.638576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:14:45.639097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:14:45.649220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.649657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.651117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.651117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.668276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:14:45.672170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for user 36893da01a1845f5af4921a298abb9eb and project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:14:45.683551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:14:45.686038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:14:45.734215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:45.734934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:45.741858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.742300 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.743085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:45.743514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:45.865892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:45.873177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ff2b93ce-fee3-439c-a007-cd7b96ef8153 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.143204 Sep 23 03:14:45.873732 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 174/338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:45 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:45.925351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fa9c5b28-e137-4a02-ab2e-a1f080a66adc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800332 Sep 23 03:14:45.925923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 165/339] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:14:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:14:45.936386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-57c5762a-810f-4313-95ac-01b142815c8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:45.937058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-57c5762a-810f-4313-95ac-01b142815c8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:45.988622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-57c5762a-810f-4313-95ac-01b142815c8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:45.995621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-57c5762a-810f-4313-95ac-01b142815c8f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1218 microversion: 2.1 time: 0.063113 Sep 23 03:14:45.996199 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 175/340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:45 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:46.511957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:46.512928 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:46.520610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:46.521280 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:46.522050 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:46.522472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:46.665292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ef6bc737-3306-4193-b8a1-cc75c60f7a92 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 25872 microversion: 2.20 time: 0.157485 Sep 23 03:14:46.666083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 166/341] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:46 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 25872 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:46.890208 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:46.890814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:46.896993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:46.897451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:46.898194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:46.898620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:47.013844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:47.014771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:47.022905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:47.024057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:47.025168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:47.026359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:47.028154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:47.035836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d0cdf11-2ad1-4458-8941-89542a943f3f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.149282 Sep 23 03:14:47.036400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 176/342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:46 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:47.091652 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:47.099431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1fde16c0-9123-46d8-ae39-1f0c65880879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1222 microversion: 2.1 time: 0.091229 Sep 23 03:14:47.099851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 167/343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:47 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:47.677459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:47.678371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:47.684056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:47.684511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:47.685294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:47.685725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:48.052767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:48.053374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:48.059675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:48.060114 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:48.060902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:48.061335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:48.179994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:48.187212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c2d1d374-cde4-4dbe-aae6-19f951e07ad0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.138704 Sep 23 03:14:48.187837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 168/344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:48 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:48.192010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:48.192633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:48.197929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:48.198375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:48.199127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:48.199558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:48.273444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:48.283146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-35473061-1685-4017-be8b-6a350eb2e898 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1214 microversion: 2.1 time: 0.094340 Sep 23 03:14:48.284071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 169/345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:48 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:49.203872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:49.204481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:49.210293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:49.210732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:49.211481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:49.211904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:49.329943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:49.337850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8fa03360-a5a0-492e-9f20-ef22a359ccf8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.137599 Sep 23 03:14:49.342585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 170/346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:49 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:49.342585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:49.343178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:49.349379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:49.349991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:49.350737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:49.351154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:49.409094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:49.416186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-30ca2c51-4b21-450f-bf7e-d9583542df5e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1214 microversion: 2.1 time: 0.076841 Sep 23 03:14:49.416773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 171/347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:49 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:50.354381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:50.354984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:50.361380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:50.361820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:50.362566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:50.362994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:50.480464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:50.487858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3ee9f892-8420-4172-8f7c-3d443db4ceb0 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.137064 Sep 23 03:14:50.489019 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 172/348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:50 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:50.493062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:50.493650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:50.498850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:50.499291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:50.500038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:50.500466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:50.561167 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:50.568138 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-390b5f8b-9792-440e-834d-4ff310550ed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1214 microversion: 2.1 time: 0.078244 Sep 23 03:14:50.568736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 173/349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:50 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:51.505158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:51.506529 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:51.512345 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:51.512750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:51.513511 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:51.513973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:51.632131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:51.639383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0608de77-4c59-4299-a737-638b5de19173 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.137894 Sep 23 03:14:51.639970 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 174/350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:51 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:51.644137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:51.645349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:51.650630 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:51.651073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:51.651817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:51.652326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:51.709548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:51.716465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aac8266b-1a16-4304-8cda-0fd6209ca302 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1214 microversion: 2.1 time: 0.075552 Sep 23 03:14:51.717044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 175/351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:51 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:52.044321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-92529c7d-9854-4874-bed3-44c43548093b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 27857 microversion: 2.20 time: 4.370737 Sep 23 03:14:52.044991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 177/352] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:47 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 27857 bytes in 4372 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:52.655724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:52.656330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:52.662174 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:52.662617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:52.663369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:52.663804 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:52.733716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:52.734429 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:52.741352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:52.741789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:52.742545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:52.743026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:52.784307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:52.793602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-456bb458-3e99-4cb3-a914-271c782ffafb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.141499 Sep 23 03:14:52.794477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 176/353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:52 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:52.804874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:52.818547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-94917968-c0fc-4689-b833-e417d4c1319d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1270 microversion: 2.1 time: 0.088878 Sep 23 03:14:52.819131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 178/354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:52 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:53.056590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:53.057569 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:53.063185 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.063617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.064360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.064813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.448120 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7a373369-5283-47e2-b320-7f2369d77bbd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 27923 microversion: 2.20 time: 0.395195 Sep 23 03:14:53.449034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 177/355] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:53 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 27923 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:14:53.835453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:53.836054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:53.842230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.843611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.843611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.843936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.852172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:53.853414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:53.867649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.868301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.869158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:53.869801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:53.964245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:53.973310 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8bc26404-2284-468d-b3b9-b642996c657f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1278 microversion: 2.1 time: 0.141165 Sep 23 03:14:53.979597 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 179/356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:53 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:54.006351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:54.014475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3f24a319-4cb7-40aa-be09-26ac5e4dacf9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.168815 Sep 23 03:14:54.015090 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 178/357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:53 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:54.462943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:54.462943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:54.468849 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:54.469533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:54.470951 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:54.472413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:54.612957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b529af8c-bcc6-4200-92f6-3b2b02265a2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28050 microversion: 2.20 time: 0.157364 Sep 23 03:14:54.618863 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 180/358] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:54 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28050 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:54.991436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:54.992121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:54.998626 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:54.999075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:54.999844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.000272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.052165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:55.052165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:55.052165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.052165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.053138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.053138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.155078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:55.165903 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-87d91b2b-8b35-46a1-aee6-965f50466410 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.176808 Sep 23 03:14:55.165903 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 179/359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:54 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:55.168690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2061473180", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:55.214035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:55.226802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ebe9b419-1273-4370-9d67-df6a467abfae tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.199061 Sep 23 03:14:55.227387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 181/360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:55 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:55.233915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:55.247316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:55.247316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.247316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.248005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] validate_networks() for None {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:14:55.248216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.248216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.284724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:14:55.586237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:14:55.586678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:14:55.587146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:14:55.587547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:14:55.587953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:14:55.609673 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.610120 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.610915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.611348 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.630615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Getting quotas for project 6f66ea6efe7a4d2cb84edec8a4b42ad3. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:14:55.634913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Getting quotas for user c56e9f5417c743fc938f86802e50b143 and project 6f66ea6efe7a4d2cb84edec8a4b42ad3. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:14:55.646069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:14:55.648434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:14:55.700908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2d668640-7af1-49f7-a6d5-499274981c42 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 204 len: 0 microversion: 2.1 time: 0.472082 Sep 23 03:14:55.701494 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 182/361] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:14:55 2021] DELETE /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:14:55.707796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-5462c29d-c3fd-4a1e-9cf4-ba3c2b69046a req-cbbe6ea5-c33f-44c4-809f-91b0cc7f2cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65bf9db1-21c8-4b33-b64e-ad883343ff9a", "tag": "870ddb4f-c1ed-4a3d-9a01-248d232a6fa2"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:55.709343 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:14:55.709343 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:14:55.716473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-5462c29d-c3fd-4a1e-9cf4-ba3c2b69046a req-cbbe6ea5-c33f-44c4-809f-91b0cc7f2cc5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.716926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-5462c29d-c3fd-4a1e-9cf4-ba3c2b69046a req-cbbe6ea5-c33f-44c4-809f-91b0cc7f2cc5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.734381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-5462c29d-c3fd-4a1e-9cf4-ba3c2b69046a req-cbbe6ea5-c33f-44c4-809f-91b0cc7f2cc5 service nova] Creating event network-changed:870ddb4f-c1ed-4a3d-9a01-248d232a6fa2 for instance 65bf9db1-21c8-4b33-b64e-ad883343ff9a on hv-cinder-76845 Sep 23 03:14:55.734381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-5462c29d-c3fd-4a1e-9cf4-ba3c2b69046a req-cbbe6ea5-c33f-44c4-809f-91b0cc7f2cc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028253 Sep 23 03:14:55.734381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 183/362] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:14:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:14:55.737391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:55.738891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:55.744759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.745194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.745977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.746430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.865340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-12e9ca02-6dc3-4329-afe2-8182d0a26c3c tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700476 Sep 23 03:14:55.866471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 180/363] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:14:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:14:55.876083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:55.876083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:55.877911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.878362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.879746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:55.880322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:55.943360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6af532da-1657-45b1-b11d-a30e094dd3cb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28168 microversion: 2.20 time: 0.207170 Sep 23 03:14:55.944454 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 184/364] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:55 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28168 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:55.950885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ce2daade-36b3-4ce4-9fa9-7f8faba0aae5 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:55.951801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ce2daade-36b3-4ce4-9fa9-7f8faba0aae5 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:56.050297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ce2daade-36b3-4ce4-9fa9-7f8faba0aae5 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:56.065136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ce2daade-36b3-4ce4-9fa9-7f8faba0aae5 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1215 microversion: 2.1 time: 0.117365 Sep 23 03:14:56.065136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 185/365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:55 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:56.071793 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:56.084007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7a84904f-ab9b-45d8-a5f7-abcfe5d4b8e7 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1553 microversion: 2.1 time: 0.216335 Sep 23 03:14:56.084619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 181/366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:55 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:56.181020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:56.181626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:56.187740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.188181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:56.188960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.189641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:56.243477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:56.247644 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:56.250375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.250852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:56.251607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.252085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:56.335149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:56.352857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e1122268-82d1-44b2-9b3a-683dffef3d56 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.166391 Sep 23 03:14:56.352857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 186/367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:56 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:56.521632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:56.532583 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-524a7b60-2fca-476b-a0b2-9ac8d97377e5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.289104 Sep 23 03:14:56.532583 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 182/368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:56 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:56.955363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:56.956353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:56.962384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.962824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:56.963691 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:56.964115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.080957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:57.081695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:57.092931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.093096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.093865 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.094293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.097295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6ddf0a12-b3e7-4043-a005-5c675173b040 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.145271 Sep 23 03:14:57.098735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 187/369] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:56 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:57.110135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:57.111661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:57.123813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.124514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.125483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.125958 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.208596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:57.216868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ad9ddf9a-f6e2-4083-8f29-85d1ff5de839 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1219 microversion: 2.1 time: 0.139606 Sep 23 03:14:57.217534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 183/370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:57 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:57.359958 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:57.360641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:57.370630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:57.375843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.376474 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.377274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.377697 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.383178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6855f3c7-3358-466d-91dd-195dba4eef5b tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1553 microversion: 2.1 time: 0.280408 Sep 23 03:14:57.383178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 188/371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:57 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:57.538783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:57.549371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:57.549371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:57.549600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-50b3619c-2fef-481a-94d2-9969aa797bcd tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.190310 Sep 23 03:14:57.549600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 184/372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:57 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:57.553561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.554006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.554983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:57.555415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:57.726576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:57.734905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bd4652ab-43af-4692-a73d-f3200f35834c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1522 microversion: 2.1 time: 0.193135 Sep 23 03:14:57.735679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 189/373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:57 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:58.110173 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:58.112536 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:58.118864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.119649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.127025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.127025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.237959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:58.238670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:58.245105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.245603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.246393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.246821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.274806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-272afae2-f34e-40d9-bf21-cbcb533e2f60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.168608 Sep 23 03:14:58.278840 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 185/374] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:58 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:58.305935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:58.313192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d54a9d0e-9367-4f73-b238-3a288a081bf1 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1267 microversion: 2.1 time: 0.078836 Sep 23 03:14:58.313747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 190/375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:58 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:58.398495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:58.399214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:58.405656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.406141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.406918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.407351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.533428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:58.541677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-053fbf40-e117-4f57-b6e9-1a73af050c72 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1553 microversion: 2.1 time: 0.147666 Sep 23 03:14:58.542223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 186/376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:58 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:58.562716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:58.563253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:58.568975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.569415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.570353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.570929 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.751788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:58.752528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:58.758671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.759366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.760202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:58.760664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:58.973998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:58.985200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-19f39dd9-1a94-4774-83b1-bcf6d4159966 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1502 microversion: 2.1 time: 0.237163 Sep 23 03:14:59.001211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 187/377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:58 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:14:59.006569 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:59.007185 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:59.017378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.017924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.018983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.019451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.239653 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:59.258454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2be2ea50-47e8-47b5-9fca-a53684a3c82a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1516 microversion: 2.1 time: 0.255570 Sep 23 03:14:59.259259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 188/378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:59 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:59.289835 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:14:59.294496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:59.299809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.300507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.301999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.302617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.313676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:59.326663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3c57e9d7-ce85-4495-9f20-57a2e3135183 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.767119 Sep 23 03:14:59.337260 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 191/379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:58 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:59.346328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:59.347176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:59.361920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.362366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.363160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.363620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.479442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:59.487002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9cae2ce0-6c98-4760-8112-79bdae4bd930 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1273 microversion: 2.1 time: 0.148482 Sep 23 03:14:59.487564 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 192/380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:59 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:14:59.553894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9dc63a73-f99e-4de5-8919-7e482bf74570 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.269730 Sep 23 03:14:59.554322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 189/381] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:14:59 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:14:59.561911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:14:59.563279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:14:59.572998 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.573989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.574872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:14:59.575395 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:14:59.720307 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:14:59.728189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0a33bbec-f8c9-4ad5-bc2c-6b7a01238293 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1553 microversion: 2.1 time: 0.170693 Sep 23 03:14:59.728848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 193/382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:14:59 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:00.345102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:00.345882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:00.352533 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.353350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.354331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.355206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.508345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:00.509043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:00.518910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.520763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.525214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.525214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.549528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:00.558802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7b5fe4d4-a261-4812-904c-509cc7881095 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.218151 Sep 23 03:15:00.559373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 190/383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:00 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:00.571953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:00.572955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:00.590402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.590846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.591616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.592364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.642720 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:00.650147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1e22be22-8109-4a92-b980-5ada69bebc88 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1273 microversion: 2.1 time: 0.146839 Sep 23 03:15:00.656518 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 194/384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:00 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:00.657379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-bf081b62-8068-427d-9fb7-6fb0d2dee4a0 req-9a6a9e38-1489-4c72-8bcb-45fca20a2b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4135490e-a5b9-4f7f-b01b-60d0a6bf7d17", "name": "network-vif-deleted", "tag": "fe931329-5d49-473e-b438-0f6e1c7ff098"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:00.659141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:00.659141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:15:00.666287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-bf081b62-8068-427d-9fb7-6fb0d2dee4a0 req-9a6a9e38-1489-4c72-8bcb-45fca20a2b06 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.666785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-bf081b62-8068-427d-9fb7-6fb0d2dee4a0 req-9a6a9e38-1489-4c72-8bcb-45fca20a2b06 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.677693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-bf081b62-8068-427d-9fb7-6fb0d2dee4a0 req-9a6a9e38-1489-4c72-8bcb-45fca20a2b06 service nova] Creating event network-vif-deleted:fe931329-5d49-473e-b438-0f6e1c7ff098 for instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 on hv-cinder-76845 Sep 23 03:15:00.682336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-bf081b62-8068-427d-9fb7-6fb0d2dee4a0 req-9a6a9e38-1489-4c72-8bcb-45fca20a2b06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028186 Sep 23 03:15:00.683082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 195/385] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:00.746635 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:00.747324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:00.753464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.754575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.754985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:00.756083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:00.761351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d7ea888a-a15d-4931-9f97-66f3ed45fd62 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.197300 Sep 23 03:15:00.762700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 191/386] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:00 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:00.849043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:00.859720 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-95217ccf-7ac0-45ef-b115-0d4596af634c tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1511 microversion: 2.1 time: 0.117039 Sep 23 03:15:00.869338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 196/387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:00 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:01.579556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:01.580344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:01.591477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.591925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.595443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.595443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.668663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:01.671046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:01.680356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.680851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.684026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.684539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.796337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:01.796337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1011cca9-9a34-4039-a688-86d5e3a0fbfc tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.219590 Sep 23 03:15:01.804619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 192/388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:01 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:01.829113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:01.830065 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:01.837096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.837539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.838307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.838739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.948784 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bf74f2f0-9143-4bca-ab2d-72a4cff3c052 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.142579 Sep 23 03:15:01.949490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 193/389] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:01 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:01.955825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:01.964893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:01.971470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.972093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:01.972954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:01.973381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.051901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:02.067692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d70481e9-5e2b-4754-afb8-3c645953d3f0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.398575 Sep 23 03:15:02.086310 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 197/390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:01 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:02.091474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1171b7dc-ce46-4c96-8660-055eea64a112 req-e125ba73-3430-425d-8cdb-e84ecfb9810e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b694af2-fade-4765-bdff-a15fd7175a67", "tag": "e588eaae-420a-4b84-a09a-d4783209e38b"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:02.098657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415880421b3f4b7896e49188e8d1395c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580adcc8b084ba2b1b657bd1b2a9a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:02.101084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:02.101084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:15:02.108703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f913b584-5290-4418-948f-99f33989616e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 200 len: 1346 microversion: 2.1 time: 0.156406 Sep 23 03:15:02.109197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1171b7dc-ce46-4c96-8660-055eea64a112 req-e125ba73-3430-425d-8cdb-e84ecfb9810e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.109326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 194/391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:01 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:02.109822 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1171b7dc-ce46-4c96-8660-055eea64a112 req-e125ba73-3430-425d-8cdb-e84ecfb9810e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.140960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1171b7dc-ce46-4c96-8660-055eea64a112 req-e125ba73-3430-425d-8cdb-e84ecfb9810e service nova] Creating event network-changed:e588eaae-420a-4b84-a09a-d4783209e38b for instance 0b694af2-fade-4765-bdff-a15fd7175a67 on hv-cinder-76845 Sep 23 03:15:02.149060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1171b7dc-ce46-4c96-8660-055eea64a112 req-e125ba73-3430-425d-8cdb-e84ecfb9810e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061219 Sep 23 03:15:02.150093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 198/392] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:02.296993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:02.297913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:02.304351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.304842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.305837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.306269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.333700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'flavor' on Instance uuid 97ba4276-abfb-4947-920f-a0cc8dffab54 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:15:02.619238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-71bee780-b915-4e4a-aae5-460695732032 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action" status: 200 len: 32 microversion: 2.1 time: 0.325958 Sep 23 03:15:02.619866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 195/393] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:15:02 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:15:02.631885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:02.633893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:02.642376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.643363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.645344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.648074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.811443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:02.825676 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:02.843248 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.843935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.844943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.845693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.859112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:02.868242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-df2125ed-80f7-4661-a689-a0637f857e05 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.241837 Sep 23 03:15:02.884502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 199/394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:02 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:02.961642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:02.962626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:02.973888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.977652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:02.977652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:02.979430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.136250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:03.143623 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6a53d85d-c7cd-4680-b5b0-d55f89689d8b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.336060 Sep 23 03:15:03.144200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 196/395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:02 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:03.155351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:03.157284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:03.171784 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.172508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.173435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.174012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.187429 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f7b06cab-c0db-4122-b114-a064dfdd964f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.230458 Sep 23 03:15:03.188351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 200/396] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:02 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:03.193608 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:03.200005 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:03.209480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.209942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.211514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.211950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.228842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] HTTP exception thrown: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. Sep 23 03:15:03.234662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Returning 404 to user: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:03.234662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ac415763-3b10-47f8-93dc-dc14d12872b9 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 404 len: 111 microversion: 2.1 time: 0.041300 Sep 23 03:15:03.234662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 201/397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:03 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:03.391036 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:03.438255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:03.438255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.438255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.438255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.438857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.438857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] HTTP exception thrown: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. Sep 23 03:15:03.438857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Returning 404 to user: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:03.438857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a5a3ae9c-db23-4ab9-9e85-4b84bbdf961e tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037642 Sep 23 03:15:03.438857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 202/398] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:03 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:03.486600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:03.512602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4609ad15-1d40-4dbf-85b2-55934abaae21 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.360766 Sep 23 03:15:03.514778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 197/399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:03 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:03.888660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:03.889290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:03.895155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.896975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:03.896975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:03.896975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.044940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:04.054238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a6b78ce5-fd32-43c3-831a-41d6179b4bbc tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.169261 Sep 23 03:15:04.055453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 203/400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:03 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:04.170557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:04.170557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:04.170557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.170557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.171298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.171298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.203339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:04.204779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:04.211686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.212824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.213997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.214905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.316202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:04.323821 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-47a99e83-6778-4c46-97ed-87c842ac9e30 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.167661 Sep 23 03:15:04.324388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 198/401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:04 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:04.378409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bcb18501-f008-490e-8c3d-ec201e276584 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.181434 Sep 23 03:15:04.379047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 204/402] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:04 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:04.531068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:04.531674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:04.537901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.538347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.539147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:04.539581 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:04.671825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:04.679039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5396a4d1-cc90-40b9-a5ca-d431dd309709 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.151700 Sep 23 03:15:04.679587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 199/403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:04 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:05.072008 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:05.072776 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.079224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.079668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.080496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.080950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.142112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:05.142687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.150095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.150537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.151310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.151730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.166415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] HTTP exception thrown: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. Sep 23 03:15:05.167030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Returning 404 to user: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:05.167885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce723274-4721-49fc-8954-2fd6de8785cf tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 404 len: 111 microversion: 2.1 time: 0.030002 Sep 23 03:15:05.168642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 200/404] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:15:05 2021] DELETE /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:15:05.176695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:05.178059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] [instance: 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.184095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.184735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.185776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.186355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.201399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] HTTP exception thrown: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. Sep 23 03:15:05.202193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] Returning 404 to user: Instance 4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:05.203366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-addd1310-791b-4424-b4a6-2fe8c5b997c8 tempest-DeleteServersTestJSON-1532885282 tempest-DeleteServersTestJSON-1532885282-project] 10.222.0.23 "GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17" status: 404 len: 111 microversion: 2.1 time: 0.030110 Sep 23 03:15:05.204430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 201/405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:05 2021] GET /compute/v2.1/servers/4135490e-a5b9-4f7f-b01b-60d0a6bf7d17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:15:05.216963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:05.224804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b87c8971-98f3-4c21-85d4-f769a16b6da5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.156615 Sep 23 03:15:05.225602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 205/406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:05 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:05.341686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:05.342430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.349314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.349859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.351122 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.351565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.390024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:05.394652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.397215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.397838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.399239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.399830 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.517775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-de24ff59-975d-4484-bd27-c933a547c7b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.131377 Sep 23 03:15:05.518641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 206/407] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:05 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:05.530358 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:05.540144 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0739a2fe-fda0-4838-897f-dd8b5cf4e624 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.203401 Sep 23 03:15:05.541322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 202/408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:05 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:05.648657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-b4d376bf-c4c0-4c32-974a-9ff9ac0a1e7d req-03ecad2c-d9f6-4efe-bd53-aa33a543ce1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65bf9db1-21c8-4b33-b64e-ad883343ff9a", "name": "network-vif-plugged", "status": "completed", "tag": "870ddb4f-c1ed-4a3d-9a01-248d232a6fa2"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:05.650277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:05.650277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:15:05.658789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b4d376bf-c4c0-4c32-974a-9ff9ac0a1e7d req-03ecad2c-d9f6-4efe-bd53-aa33a543ce1d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.662819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b4d376bf-c4c0-4c32-974a-9ff9ac0a1e7d req-03ecad2c-d9f6-4efe-bd53-aa33a543ce1d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.671975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-b4d376bf-c4c0-4c32-974a-9ff9ac0a1e7d req-03ecad2c-d9f6-4efe-bd53-aa33a543ce1d service nova] Creating event network-vif-plugged:870ddb4f-c1ed-4a3d-9a01-248d232a6fa2 for instance 65bf9db1-21c8-4b33-b64e-ad883343ff9a on hv-cinder-76845 Sep 23 03:15:05.681101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-b4d376bf-c4c0-4c32-974a-9ff9ac0a1e7d req-03ecad2c-d9f6-4efe-bd53-aa33a543ce1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038643 Sep 23 03:15:05.682217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 207/409] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:05.695279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:05.695929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:05.701879 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.702330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.703094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:05.703882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:05.870506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:05.877876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a2b24ab2-5224-4aad-ac8b-0c02a5af6e72 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.186704 Sep 23 03:15:05.880460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 203/410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:05 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:06.242368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:06.243085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:06.248942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.249375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.250120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.250588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.374614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:06.381793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-542bc8a8-73ab-48d0-a81d-8b3b55e2f48e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.144104 Sep 23 03:15:06.382352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 208/411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:06 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:06.530038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:06.530964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:06.539764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.547034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.547887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.548323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.568390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:06.570355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:06.576397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.577049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.578130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.578572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.713092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-46868639-fb63-429d-a0f1-f345c9116125 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.186768 Sep 23 03:15:06.714393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 204/412] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:06 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:06.754400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:06.762281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-073ca389-2c94-4508-b9ce-99d3cee5bf20 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.208792 Sep 23 03:15:06.763852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 209/413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:06 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:06.896507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:06.897221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:06.904134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.904609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:06.905379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:06.905998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.033033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:07.040352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-11aa14bc-ea5c-4e96-964e-e3f104966513 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.148242 Sep 23 03:15:07.040934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 205/414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:06 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:07.398737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:07.399414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:07.405635 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.406112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.406867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.407446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.531269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:07.539952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c5b0f33e-f77b-413e-ba6b-7a8c450d120e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.144991 Sep 23 03:15:07.540918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 210/415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:07 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:07.724897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:07.725830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:07.731805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.732246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.733285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.733713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.778264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:07.778848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:07.784716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.785176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.785907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:07.786331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:07.894245 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-606be346-36db-4c04-b76e-ff273bb0b4c1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.172849 Sep 23 03:15:07.897811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 206/416] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:07 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:07.914256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:07.933238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ac821c50-7e99-4d11-9b8f-d2618c5f790d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1318 microversion: 2.1 time: 0.157189 Sep 23 03:15:07.934653 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 211/417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:07 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:08.057865 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:08.058630 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:08.065088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.065524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.066826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.067258 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.209813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:08.217097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-69ceb29a-c6e7-4891-9721-4aa3b9f5dc55 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.163208 Sep 23 03:15:08.218448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 207/418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:08 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:08.557117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:08.558488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:08.565249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.565918 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.566897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.567480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.711685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:08.721650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6458bb14-9ed0-42dc-8db2-96be0903e859 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.165752 Sep 23 03:15:08.721650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 212/419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:08 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:08.905885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:08.906795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:08.913211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.913654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.914408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.914840 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.956200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:08.957004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:08.979420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.979420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:08.979420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:08.979420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.088421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:09.096357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3cb667ce-c1f0-4b14-ad82-c2d9d79ea1f7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1506 microversion: 2.1 time: 0.143663 Sep 23 03:15:09.097108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 213/420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:08 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:09.119354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-df24ceed-25e4-4cae-b837-451c5ed55328 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.217026 Sep 23 03:15:09.123178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 208/421] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:08 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:09.123442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8dd4fab-8d93-4ab0-a556-ca261bb95d2c"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:09.124272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:09.131403 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.131845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.132641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.133069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.237287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:09.238258 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:09.247477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.247923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.257660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.257936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.270203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Invalid volume: volume a8dd4fab-8d93-4ab0-a556-ca261bb95d2c is already attached to instances: 565f86c9-78ca-4856-9083-6ed4db043086 Sep 23 03:15:09.271263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 400 to user: Invalid volume: volume a8dd4fab-8d93-4ab0-a556-ca261bb95d2c is already attached to instances: 565f86c9-78ca-4856-9083-6ed4db043086 {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:09.272687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d2c8b6be-2249-4c39-89ce-be5ac48235c5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154183 Sep 23 03:15:09.273830 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 214/422] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:15:09 2021] POST /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:15:09.401164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:09.409360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f0ac2640-3c0e-4c69-a66d-15a8cde40062 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.178154 Sep 23 03:15:09.410071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 209/423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:09 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:09.561906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:09.561906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:09.561906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.561906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.562780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.562780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.692079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'services' on Instance uuid 565f86c9-78ca-4856-9083-6ed4db043086 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:15:09.761738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:09.761738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:09.761738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.761738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.762385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:09.762385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:09.866231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:09.873552 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0f34bdcb-cc6b-4eaf-ab98-c33eaa11e53a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.141031 Sep 23 03:15:09.874156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 210/424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:09 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:10.094137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b96acc53-eeb7-4b2c-9d0b-b8d0cfe2ed29 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments/a8dd4fab-8d93-4ab0-a556-ca261bb95d2c" status: 202 len: 0 microversion: 2.1 time: 0.551318 Sep 23 03:15:10.095313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 215/425] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:15:09 2021] DELETE /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments/a8dd4fab-8d93-4ab0-a556-ca261bb95d2c => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:10.104093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:10.105638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:10.115368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.115368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.115368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.115368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.132036 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:10.133646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:10.141150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.141604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.142372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.142800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.145071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-de1c5f80-a3d7-4b10-b628-364fa4ee2bab tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Sep 23 03:15:10.146111 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 211/426] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:10 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:10.273721 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bcc8b940-9da6-483b-8c2b-45ac53cf7042 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.146133 Sep 23 03:15:10.274763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 216/427] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:10 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:10.428606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:10.429433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:10.435568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.436010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.436805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.437233 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.610641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:10.619312 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8cb5dec2-9526-4c5a-8df6-9eb370f1449a tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.194873 Sep 23 03:15:10.624569 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 212/428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:10 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:10.891368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:10.892216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:10.899242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.899780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:10.900663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:10.901157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.042601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:11.049828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-73ef6c02-709a-47ec-a4b5-3b6fb34ecd43 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.162772 Sep 23 03:15:11.050955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 217/429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:10 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:11.156178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:11.157248 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:11.163496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.163944 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.164731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.165193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.193836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c559d350-2b00-4e4a-b394-733a901ddd46 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Sep 23 03:15:11.194385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 213/430] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:11 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:11.286334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:11.287239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:11.295146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.295685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.296340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.296781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.638722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:11.639325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:11.645004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.645431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.647301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:11.647301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:11.773501 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:11.781470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-82f0b328-50ea-44a8-9ca7-19a99e57d112 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.145689 Sep 23 03:15:11.785038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 214/431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:11 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:12.067877 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:12.068516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:12.074264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.074710 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.075473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.075902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.194059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:12.201530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce23c8a1-1660-4918-925b-820328c23d4a tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.137807 Sep 23 03:15:12.202094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 215/432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:12 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:12.206530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:12.208106 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:12.213904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.214380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.215140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.215571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.244664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2102e226-65f3-4a48-a8fa-5186595933a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041533 Sep 23 03:15:12.245219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 216/433] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:12 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:12.455816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0ae10b24-6b5d-431f-9933-20a374fa8b31 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 1.173569 Sep 23 03:15:12.456459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 218/434] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:11 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:12.688671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-45963712-7f3c-4112-8b52-2c20c14d48ad req-c60a9643-79c8-44e8-9061-7d336b6d0761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b694af2-fade-4765-bdff-a15fd7175a67", "name": "network-vif-plugged", "status": "completed", "tag": "e588eaae-420a-4b84-a09a-d4783209e38b"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:12.700590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:12.700590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:15:12.700590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-45963712-7f3c-4112-8b52-2c20c14d48ad req-c60a9643-79c8-44e8-9061-7d336b6d0761 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.700590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-45963712-7f3c-4112-8b52-2c20c14d48ad req-c60a9643-79c8-44e8-9061-7d336b6d0761 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.709928 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-45963712-7f3c-4112-8b52-2c20c14d48ad req-c60a9643-79c8-44e8-9061-7d336b6d0761 service nova] Creating event network-vif-plugged:e588eaae-420a-4b84-a09a-d4783209e38b for instance 0b694af2-fade-4765-bdff-a15fd7175a67 on hv-cinder-76845 Sep 23 03:15:12.715045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-45963712-7f3c-4112-8b52-2c20c14d48ad req-c60a9643-79c8-44e8-9061-7d336b6d0761 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Sep 23 03:15:12.715612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 217/435] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:12.798231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:12.798917 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:12.805406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.805839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.806633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:12.807065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:12.930752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:12.938157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37c9c82a-202e-4541-9c40-bd8cf125e41e tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.143792 Sep 23 03:15:12.938801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 219/436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:12 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:13.218726 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:13.219493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:13.225535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.225973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.229077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.229077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.255643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:13.256643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:13.262437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.262872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.263625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.264050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.297292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-00c01ab7-b879-4330-b949-0870a7e148d4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Sep 23 03:15:13.297885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 220/437] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:13 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:13.348897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:13.356183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-63dad386-be0e-4398-8fe1-d050b6f4f27e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.141390 Sep 23 03:15:13.356853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 218/438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:13 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:13.467593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:13.468510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:13.474344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.474785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.475544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.475968 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.954761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:13.955391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:13.965153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.965153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:13.965153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:13.965153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:14.089736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:14.097178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ed06169d-ebc2-47dd-b15c-a63e1765f1ff tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.146009 Sep 23 03:15:14.098738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 219/439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:13 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:14.309240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:14.310172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:14.315847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:14.316813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:14.317564 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:14.317988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:14.346628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cf6bea41-1852-4465-a259-a83c24ac2f78 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Sep 23 03:15:14.347170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 220/440] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:14 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:14.373147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:14.373797 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:14.380375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:14.380870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:14.381614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:14.382039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:14.500860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:14.508081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-05579cca-531a-477a-b184-4dd1f44c976b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.138634 Sep 23 03:15:14.508759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 221/441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:14 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:15.117633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:15.118346 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:15.124956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.129014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.129014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.129014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.178538 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-45456e8d-83c5-42fd-bb7c-f54332591461 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 1.714476 Sep 23 03:15:15.187470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 221/442] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:13 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:15.291899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:15.299094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ca0d0bba-f629-4bd7-912d-9e45708e40af tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.188290 Sep 23 03:15:15.299655 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 222/443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:15 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:15.360506 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:15.361628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:15.368423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.369087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.369853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.370285 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.404019 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6999c2b4-8f2e-46fb-8f5f-b78eb6200dbe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049228 Sep 23 03:15:15.404913 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 222/444] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:15 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:15.525362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:15.525989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:15.531660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.532104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.532892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:15.533325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:15.651526 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:15.658886 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0074b701-2a64-4587-8f19-49dd733d11b3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.137214 Sep 23 03:15:15.659442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 223/445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:15 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:16.197567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:16.198604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:16.204249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.204727 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.205471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.205954 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.308598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2bb42fbb-de6d-4d15-953b-1ab36c829485 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.114661 Sep 23 03:15:16.309286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 223/446] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:16 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:16.314680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:16.315295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:16.321172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.321611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.322364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.322792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.415588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:16.417288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:16.423207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.423652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.424424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.424889 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.445550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:16.452869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0774f32b-8faa-4a62-ba03-a7b7f3b39175 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.141712 Sep 23 03:15:16.453458 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 224/447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:16 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:16.458637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6f76d27f-11a7-47f8-8553-be7b14b1bcd5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047097 Sep 23 03:15:16.459187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 224/448] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:16 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:16.675584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:16.676103 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:16.681935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.682378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.683138 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:16.683568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:16.807100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:16.813064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d1fa04a1-4fbc-4ea8-80a8-a7089b4b0e81 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.141335 Sep 23 03:15:16.813631 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 225/449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:16 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:17.320131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:17.321624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:17.328543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.331090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.331090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.331090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.469721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:17.470576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:17.479076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.479076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.479076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.479076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.507376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-41cecce9-c20b-4bd2-82ad-3c33f24094d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041554 Sep 23 03:15:17.507938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 226/450] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:15:17 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:15:17.512079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:17.512811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:17.518261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.518706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.519460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.519969 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.635474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-026a8eb2-acbc-4ead-b2a4-4a29ad470e3d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.319541 Sep 23 03:15:17.637249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 225/451] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:17 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:17.655185 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:17.662433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-45e5588b-fa38-4335-97f2-b0beb6cc8681 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1315 microversion: 2.1 time: 0.153564 Sep 23 03:15:17.662990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 227/452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:17 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:17.699125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1800940567", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "803c4c70-2ff9-4ddc-a896-3501f0b2a0a2"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:17.749036 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] validate_networks() for [('803c4c70-2ff9-4ddc-a896-3501f0b2a0a2', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:15:17.832609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:17.833214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:17.840954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.842969 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:17.843767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:17.844201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.010731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:18.020181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5fe4d346-b381-409c-bb8c-5a91046704cf tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.191768 Sep 23 03:15:18.032755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 228/453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:17 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:18.338763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:15:18.339563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:15:18.340152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:15:18.340703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:15:18.341205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:15:18.352276 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.355567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.355567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.355567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.369985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:15:18.373915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for user 36893da01a1845f5af4921a298abb9eb and project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:15:18.384460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:15:18.386891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:15:18.501567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cb2aa3f2-0c98-47d9-a97e-efa15f26be22 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806391 Sep 23 03:15:18.502405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 226/454] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:15:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:15:18.511949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3ec3415a-ff0a-4686-9217-5729f4eab885 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:18.512762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3ec3415a-ff0a-4686-9217-5729f4eab885 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:18.574945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3ec3415a-ff0a-4686-9217-5729f4eab885 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:18.583133 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3ec3415a-ff0a-4686-9217-5729f4eab885 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1218 microversion: 2.1 time: 0.075037 Sep 23 03:15:18.584055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 229/455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:18 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:18.647744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:18.648872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:18.655851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.656303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.658640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.659103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.683266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:18.686942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:18.694644 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.695536 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.697618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.698227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.826701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4d97cb4d-71d5-40fb-b51d-74bf352d3865 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.182720 Sep 23 03:15:18.828852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 227/456] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:18 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:18.861819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:18.869266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-507e98f0-a11f-4d1c-b13a-9d88b895d4b0 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1464 microversion: 2.1 time: 0.193358 Sep 23 03:15:18.870132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 230/457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:18 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:18.927271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:18.928176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:18.934636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.935067 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.936097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:18.936793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:18.964533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:15:19.038247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:19.039217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:19.046272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.047051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.050438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.050438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.196012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:19.203241 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3f0b7287-99e5-4bea-8228-a95d89c38685 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.169421 Sep 23 03:15:19.203805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 231/458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:19 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:19.306046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c887db6c-0adf-40be-b189-c701a8771b75 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 204 len: 0 microversion: 2.1 time: 0.383482 Sep 23 03:15:19.306630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 228/459] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:15:18 2021] DELETE /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:15:19.314514 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:19.315064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:19.335651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.336216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.337113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.337543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.480605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:19.488351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-74ce7d98-168d-4340-b871-4ca603b23457 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1470 microversion: 2.1 time: 0.177410 Sep 23 03:15:19.488969 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 232/460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:19 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:19.602651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:19.603351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:19.622468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.622932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.624237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.626676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.695528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:19.703168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-92eb3690-6bb5-4372-ba77-380da0e85959 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1222 microversion: 2.1 time: 0.105776 Sep 23 03:15:19.709954 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 229/461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:19 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:19.839895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:19.840910 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:19.846660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.847105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.847895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:19.848323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:19.965570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ea41f23b-2a31-434a-b5d5-61f75a916fa3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28285 microversion: 2.20 time: 0.129121 Sep 23 03:15:19.967061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 233/462] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:19 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:20.219548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:20.220155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:20.226901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.227352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.228117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.228573 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.361053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:20.375342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-570bd71e-5af1-416d-a2ca-4693a70586eb tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.155766 Sep 23 03:15:20.375342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 230/463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:20 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:20.507005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:20.509007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:20.515060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.515684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.516642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.517215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.682111 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:20.682111 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7f05e5f5-7265-4faa-8765-010706e382a9 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1470 microversion: 2.1 time: 0.175558 Sep 23 03:15:20.682111 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 234/464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:20 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:20.720706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:20.721986 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:20.735040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.735813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.736878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.737469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.819784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:20.835657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e5587d20-60d9-4d9e-a804-3003be946dee tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1270 microversion: 2.1 time: 0.117997 Sep 23 03:15:20.836654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 231/465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:20 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:20.977351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:20.979199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:20.985460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.985968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:20.986803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:20.987320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.110522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce258293-7b24-463d-a221-f9be90cf4034 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28574 microversion: 2.20 time: 0.136616 Sep 23 03:15:21.111089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 235/466] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:20 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:21.391753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:21.392348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.400610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.401113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.401941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.402372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.568613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:21.577330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ecb4b748-2ecb-48de-b568-91e4bfc7e4a5 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1502 microversion: 2.1 time: 0.189560 Sep 23 03:15:21.578257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 232/467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:21 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:21.596099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1510b0c4-83bd-4b70-9a7e-80c679d8288d"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:21.597809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.606097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.606885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.608236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.608801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.634986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] HTTP exception thrown: Cannot 'attach_volume' instance 97ba4276-abfb-4947-920f-a0cc8dffab54 while it is in vm_state rescued Sep 23 03:15:21.635578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Returning 409 to user: Cannot 'attach_volume' instance 97ba4276-abfb-4947-920f-a0cc8dffab54 while it is in vm_state rescued {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:21.636397 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ec276ca3-68db-4214-971c-54cffd236c85 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044688 Sep 23 03:15:21.637124 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 236/468] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:15:21 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:15:21.650357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:21.650881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.656631 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.657084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.661791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.665397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.697333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:21.698283 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.708605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.712505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.713715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.714325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.884889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:21.892347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0532a73a-3be9-4b64-99c2-ee58046fff70 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1470 microversion: 2.1 time: 0.201122 Sep 23 03:15:21.892939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 237/469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:21 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:21.898572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:21.899224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.905344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.914507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.914507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.914507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.940088 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e5176865-43ac-4293-9aca-6d1328537866 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action" status: 202 len: 0 microversion: 2.1 time: 0.293204 Sep 23 03:15:21.944951 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 233/470] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:15:21 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:21.960125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:21.961115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:21.967463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.967905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.968907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:21.969345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:21.995689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:22.004119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-001afc88-55cf-4837-924e-10879abc7b28 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1276 microversion: 2.1 time: 0.109534 Sep 23 03:15:22.005267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 238/471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:21 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:22.122843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:22.123744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:22.124852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:22.133125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-028d4801-3309-430c-8db5-f6269bed7e25 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1510 microversion: 2.1 time: 0.177604 Sep 23 03:15:22.134380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:22.134744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 234/472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:21 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:22.135595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:22.136720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:22.137361 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:22.258812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ff02badd-d895-458d-8c4f-0045a68cd4f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28574 microversion: 2.20 time: 0.140311 Sep 23 03:15:22.261177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 239/473] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:22 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:22.773994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-f5036cb0-bbbc-41c2-b2c2-6ca4c6e47662 req-1a65a855-82bd-4973-8324-4b1ae3a08146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b694af2-fade-4765-bdff-a15fd7175a67", "name": "network-vif-deleted", "tag": "e588eaae-420a-4b84-a09a-d4783209e38b"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:22.775816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:22.775816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:15:22.785894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f5036cb0-bbbc-41c2-b2c2-6ca4c6e47662 req-1a65a855-82bd-4973-8324-4b1ae3a08146 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:22.786592 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f5036cb0-bbbc-41c2-b2c2-6ca4c6e47662 req-1a65a855-82bd-4973-8324-4b1ae3a08146 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:22.799512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-f5036cb0-bbbc-41c2-b2c2-6ca4c6e47662 req-1a65a855-82bd-4973-8324-4b1ae3a08146 service nova] Creating event network-vif-deleted:e588eaae-420a-4b84-a09a-d4783209e38b for instance 0b694af2-fade-4765-bdff-a15fd7175a67 on hv-cinder-76845 Sep 23 03:15:22.827908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-f5036cb0-bbbc-41c2-b2c2-6ca4c6e47662 req-1a65a855-82bd-4973-8324-4b1ae3a08146 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056623 Sep 23 03:15:22.829421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 235/474] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:22.910306 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:22.911083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:22.919463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:22.920234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:22.921371 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:22.922647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.001892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:23.010806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-81229fe7-dacc-4012-a035-48f7496aff51 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1428 microversion: 2.1 time: 0.104653 Sep 23 03:15:23.020725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 240/475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:22 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:23.025229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:23.026067 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:23.032614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.033157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.034130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.034651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.150636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:23.155638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:23.164961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.166672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.168041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.168499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.277380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:23.285192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0f835b42-2387-4519-af1b-a16f3fd6c92a tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.266426 Sep 23 03:15:23.285784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 236/476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:23 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:23.297319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:23.298796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:23.307176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.307928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.309885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.310479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.324765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:23.330217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3d450da9-b531-4320-97c9-6d10b2895858 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1510 microversion: 2.1 time: 0.183107 Sep 23 03:15:23.332296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 241/477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:23 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:23.458014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-34139f45-e609-488e-98a2-6f29704994ec tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28574 microversion: 2.20 time: 0.170700 Sep 23 03:15:23.458676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 237/478] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:23 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:23.640723 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-6040fd23-d9ef-4665-ab77-2eed31ba2082 req-d16e8fb9-f035-4a55-886d-5da3cd68614f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1794ea1-9fe8-477d-9b84-69b84a923ec2", "tag": "032fd351-ef94-4f58-8754-acd5c5fa124d"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:23.645912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:23.645912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:15:23.649835 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-6040fd23-d9ef-4665-ab77-2eed31ba2082 req-d16e8fb9-f035-4a55-886d-5da3cd68614f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:23.650274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-6040fd23-d9ef-4665-ab77-2eed31ba2082 req-d16e8fb9-f035-4a55-886d-5da3cd68614f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:23.661841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-6040fd23-d9ef-4665-ab77-2eed31ba2082 req-d16e8fb9-f035-4a55-886d-5da3cd68614f service nova] Creating event network-changed:032fd351-ef94-4f58-8754-acd5c5fa124d for instance f1794ea1-9fe8-477d-9b84-69b84a923ec2 on hv-cinder-76845 Sep 23 03:15:23.666770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-6040fd23-d9ef-4665-ab77-2eed31ba2082 req-d16e8fb9-f035-4a55-886d-5da3cd68614f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Sep 23 03:15:23.667807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 242/479] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:24.030757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:24.031492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:24.038916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.039377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.040281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.042557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.074769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.075259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.075707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lazy-loading 'fault' on Instance uuid 0b694af2-fade-4765-bdff-a15fd7175a67 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:15:24.123893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56e9f5417c743fc938f86802e50b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f66ea6efe7a4d2cb84edec8a4b42ad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:24.132049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-163a0ae6-dee3-42be-9b91-359a0b12c489 tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 200 len: 1305 microversion: 2.1 time: 0.105479 Sep 23 03:15:24.132861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 238/480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:24 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:24.304029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:24.304759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:24.313667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.316997 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.316997 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.316997 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.348466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:24.349176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:24.359653 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.360093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.366006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.367315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.530288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:24.537674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ebf3e3c6-0141-4011-bcdd-340b849acaa1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.239298 Sep 23 03:15:24.540666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 243/481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:24 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:24.542790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:24.543751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:24.551441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.552117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.553053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:24.553471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:24.646422 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:24.653596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-930f90ab-609b-49db-99ae-fd08dcb25271 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1510 microversion: 2.1 time: 0.310249 Sep 23 03:15:24.654154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 239/482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:24 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:24.708255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b12ac1b9-8243-4402-a0f2-0ecb2926c194 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.168649 Sep 23 03:15:24.712176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 244/483] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:24 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:25.151659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:25.152931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] [instance: 0b694af2-fade-4765-bdff-a15fd7175a67] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:25.159419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.160426 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.162300 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.162300 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.175128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] HTTP exception thrown: Instance 0b694af2-fade-4765-bdff-a15fd7175a67 could not be found. Sep 23 03:15:25.175789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] Returning 404 to user: Instance 0b694af2-fade-4765-bdff-a15fd7175a67 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:15:25.176633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-54e320a8-99db-4f1d-bd40-d45cc109670b tempest-VolumesNegativeTest-1883685548 tempest-VolumesNegativeTest-1883685548-project] 10.222.0.23 "GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67" status: 404 len: 111 microversion: 2.1 time: 0.028763 Sep 23 03:15:25.177488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 240/484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:25 2021] GET /compute/v2.1/servers/0b694af2-fade-4765-bdff-a15fd7175a67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:15:25.559686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:25.560387 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:25.567557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.568011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.568806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.569240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.670755 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:25.671354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:25.681778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.683262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.683262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.683471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.702166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:25.717350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2c02512a-77ba-40bb-9313-7574cd9c2eb3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.161556 Sep 23 03:15:25.717916 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 245/485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:25 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:25.724312 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:25.725457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:25.732325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.733290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.734285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:25.735114 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:25.832860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:25.838496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e2882385-d22c-4d2c-91dd-5b833c3754dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.119191 Sep 23 03:15:25.839140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 246/486] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:25 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:25.840737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-033fcfeb-ada2-42e9-963d-86dc41123ac9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1510 microversion: 2.1 time: 0.173486 Sep 23 03:15:25.841453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 241/487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:25 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:26.736410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:26.737315 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:26.745130 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.745758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:26.746679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.747257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:26.853757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:26.853757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:26.861118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.861802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:26.863015 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.863647 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:26.957081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:26.967949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-31e81b23-2e94-49eb-834f-e875824c21a8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.235904 Sep 23 03:15:26.968540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 247/488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:26 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:26.973626 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:26.974222 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:26.983216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.984576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:26.986159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:26.986799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:27.069830 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8562a0d6-7e12-46e4-a61d-1f897f00a45d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.221207 Sep 23 03:15:27.071214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 242/489] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:26 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:27.201895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:27.211859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3f04188c-7c01-4c53-a859-e24ba0a7e51d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1510 microversion: 2.1 time: 0.242275 Sep 23 03:15:27.213640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 248/490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:26 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:27.985844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:27.986528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:28.000092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.000462 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.003163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.003163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.083163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:28.084074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:28.091894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.092474 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.093274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.093704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.150641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:28.157937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-72a89f49-6bc7-4933-8889-f09c7b679856 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.176373 Sep 23 03:15:28.158646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 243/491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:27 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:28.194043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9d024cee-744a-4a38-9a21-7cdadb123a8f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.115161 Sep 23 03:15:28.194682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 249/492] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:28 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:28.229132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:28.229800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:28.235857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.236349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.237142 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:28.237567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:28.368149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:28.375468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3bb42dd8-3243-41d0-9db6-37be62bcf326 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1516 microversion: 2.1 time: 0.149995 Sep 23 03:15:28.376042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 244/493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:28 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:29.174718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:29.175542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:29.184151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:29.184783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:29.185914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:29.186530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:29.208049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:29.209186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:29.222814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:29.225433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:29.225433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:29.225433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:29.327817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-164797d3-ceae-4aa2-9905-10995d007e5e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.125375 Sep 23 03:15:29.329065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 245/494] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:29 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:29.341545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:29.348912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1081de8c-9302-4c91-820e-4cfff59fed68 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.178434 Sep 23 03:15:29.349546 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 250/495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:29 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:30.341341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:30.342455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:30.349002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:30.349450 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:30.350197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:30.350619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:30.367428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:30.368107 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:30.374409 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:30.374845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:30.375600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:30.376018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:30.448042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a73b8fc2-7935-4deb-93e2-7512c057589d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.110636 Sep 23 03:15:30.448712 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 246/496] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:30 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:30.536987 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:30.544081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b491581e-0f59-495b-bdca-d21b6f8430f8 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.182067 Sep 23 03:15:30.544656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 251/497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:30 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:31.459438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:31.460419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:31.467044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.467666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.468670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.469250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.531556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:31.532163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:31.538540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.538985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.539829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.540155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.557209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1798d808-d6df-4134-9fdd-e08b4e7465b7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.101565 Sep 23 03:15:31.557882 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 247/498] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:31 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:31.576998 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:31.578023 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:31.586929 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.587364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.588298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.588893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.692047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:31.699640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-af2ce266-58eb-410e-8492-899bac65a823 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1516 microversion: 2.1 time: 0.171627 Sep 23 03:15:31.700211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 252/499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:31 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:31.719113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24464e14-bad1-43eb-869d-22578bec7848"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:31.720299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:31.730647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.731275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.732845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.733428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.744789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:31.752671 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e06621f7-c0e7-4c3e-84eb-40043e8a4042 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.189106 Sep 23 03:15:31.753220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 248/500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:31 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:31.878114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-e5bc3d2b-d33f-4a8d-b758-fef6eb66d6a6 req-9f731a69-e2c8-4fe6-820a-49f8b671b00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1794ea1-9fe8-477d-9b84-69b84a923ec2", "name": "network-vif-plugged", "status": "completed", "tag": "032fd351-ef94-4f58-8754-acd5c5fa124d"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:31.879656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:15:31.879656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:15:31.886823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e5bc3d2b-d33f-4a8d-b758-fef6eb66d6a6 req-9f731a69-e2c8-4fe6-820a-49f8b671b00a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:31.887275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e5bc3d2b-d33f-4a8d-b758-fef6eb66d6a6 req-9f731a69-e2c8-4fe6-820a-49f8b671b00a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:31.900545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-e5bc3d2b-d33f-4a8d-b758-fef6eb66d6a6 req-9f731a69-e2c8-4fe6-820a-49f8b671b00a service nova] Creating event network-vif-plugged:032fd351-ef94-4f58-8754-acd5c5fa124d for instance f1794ea1-9fe8-477d-9b84-69b84a923ec2 on hv-cinder-76845 Sep 23 03:15:31.906446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-e5bc3d2b-d33f-4a8d-b758-fef6eb66d6a6 req-9f731a69-e2c8-4fe6-820a-49f8b671b00a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031419 Sep 23 03:15:31.907028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 249/501] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:15:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:32.475779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3e2a3825-3d26-4def-b057-f1904dd95b9c tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763568 Sep 23 03:15:32.476410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 253/502] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:15:31 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:15:32.572471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:32.573610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:32.580598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:32.581108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:32.582453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:32.583049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:32.781127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:32.781825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:32.791689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:32.792130 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:32.793029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:32.793465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:32.876445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ef66636f-a14a-467c-b7f7-854952293625 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.310310 Sep 23 03:15:32.877205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 250/503] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:32 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:32.915906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:32.924159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fd98bdc8-86d1-49e7-9470-448c2b158013 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.147477 Sep 23 03:15:32.925266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 254/504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:32 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:33.888935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:33.889917 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:33.896952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:33.897392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:33.898195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:33.898678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:33.941938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:33.942579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:33.948900 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:33.949286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:33.950045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:33.950480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:34.101000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:34.108575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1969b3b4-9463-4bee-ba39-ebf3c841b252 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.170728 Sep 23 03:15:34.109382 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 255/505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:33 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:35.125675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:35.126328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:35.132578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:35.133028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:35.133792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:35.134221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:35.272315 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:35.280291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3b7f5ce9-46ff-4a46-8204-c17120cd4c67 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.158054 Sep 23 03:15:35.281261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 256/506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:35 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:15:36.296876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:36.297615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:36.303889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:36.304334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:36.305129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:36.305561 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:36.430418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:36.439499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2f2043b4-a2d6-4d60-9d6e-34f1deecd756 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.146231 Sep 23 03:15:36.440059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 257/507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:36 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:36.480104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5464933d-6436-4d79-9b94-4caa445db37c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 2.595308 Sep 23 03:15:36.481403 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 251/508] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:33 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:37.456031 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:37.456593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:37.462395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:37.462836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:37.463586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:37.464038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:37.493032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:37.494013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:37.500342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:37.500821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:37.501572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:37.501993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:37.581337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:37.588391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a9d40467-1603-4ca1-8ebc-0736717f126d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1318 microversion: 2.1 time: 0.136079 Sep 23 03:15:37.588978 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 258/509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:37 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:38.063482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4f304b73-1576-4aa5-8e84-aea5376b93ba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.574217 Sep 23 03:15:38.064155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 252/510] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:37 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:38.605235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:15:38.605820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:38.611768 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:38.612201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:38.613020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:38.613442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:38.730029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:15:38.737792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc9baf1a-5f2a-40d1-a4e9-d7b04d84dcb6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1506 microversion: 2.1 time: 0.136049 Sep 23 03:15:38.738262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 259/511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:15:38 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1506 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:15:39.081670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:39.083676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:39.090408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:39.090853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:39.091619 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:39.092152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:42.379016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c2366d92-3512-4718-93c4-eee8c278ae55 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 3.300437 Sep 23 03:15:42.379678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 253/512] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:39 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 3303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:43.389815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:43.390777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:43.397764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:43.398201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:43.398950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:43.399373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:43.502091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b79bc742-94e4-4f2d-9421-f8f82a32370f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.115926 Sep 23 03:15:43.502793 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 260/513] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:43 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:44.514567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:44.515558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:44.522476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:44.522913 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:44.523672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:44.524098 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:47.324934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f2056e87-1f4f-4cc8-81cc-26244ad18d95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 2.814173 Sep 23 03:15:47.325566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 254/514] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:44 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:48.342679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:48.342679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:48.344807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:48.344959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:48.345682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:48.346107 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:48.475720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-94af4f70-761b-4d93-96c7-72c02043fb15 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.142657 Sep 23 03:15:48.476611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 261/515] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:48 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:49.488367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:49.489410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:49.495782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:49.496212 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:49.496994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:49.497416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:49.604056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-986c71f9-c160-40c6-a131-1c4c12a7ace6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.120374 Sep 23 03:15:49.604713 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 255/516] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:49 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:50.616121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:50.617145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:50.623834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:50.624374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:50.625239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:50.625671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:50.728562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4773f9d9-20e4-40b9-9f74-0a6f24895b06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.116935 Sep 23 03:15:50.729237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 262/517] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:50 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:51.063501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def6f587-71ec-44cd-985b-0d9cd686e357"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:51.083983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:51.083983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:51.083983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:51.083983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:51.084332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:51.740956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:51.741950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:51.748548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:51.748994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:51.749749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:51.750177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:54.961753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6b4d01c5-ff9b-45ca-afaf-0ac2cb83e44d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.902076 Sep 23 03:15:54.962381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 256/518] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:15:51 2021] POST /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 194 bytes in 3904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:15:55.851431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-01de7d9d-12a5-4240-b6f1-85c6158d1cc1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 4.114339 Sep 23 03:15:55.852120 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 263/519] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:51 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 4116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:15:56.869003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:56.870214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:56.877214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:56.877663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:56.878434 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:56.878869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:56.976846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b54f5b2f-f06b-4464-ba59-486fb227fac8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.111730 Sep 23 03:15:56.977517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 257/520] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:56 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:15:57.989459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:15:57.990501 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:15:57.996892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:57.997331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:15:57.998086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:15:57.998519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:01.217860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fefe38ba-04d7-4896-92b9-13614331356f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 3.232746 Sep 23 03:16:01.218499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 264/521] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:15:57 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 3234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:02.230718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:02.233934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:02.238639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:02.239075 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:02.239827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:02.240340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:02.400247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6e950c77-c0b4-4aba-a0fd-11975111eae7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.173413 Sep 23 03:16:02.400931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 258/522] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:02 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:03.412819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:03.413808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:03.420165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:03.420931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:03.421838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:03.422351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:03.539366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-22f8e6a7-27dc-4428-8140-519e95fc138b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.130537 Sep 23 03:16:03.541737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 265/523] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:03 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:04.552764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:04.553752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:04.560809 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:04.561259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:04.562064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:04.562640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:04.650283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d1be3fb0-c97c-4c21-8857-2ad28c14c2c8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.101328 Sep 23 03:16:04.650900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 259/524] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:04 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:05.662596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:05.663653 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:05.670000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:05.670440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:05.671196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:05.671622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:05.759582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d59c6c9c-cd18-4b16-b4eb-3922a20a0747 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.100780 Sep 23 03:16:05.760152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 266/525] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:05 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:06.771384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:06.772459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:06.778779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:06.779219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:06.779989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:06.780416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:06.884975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4446a68a-cbc1-4d17-bd9d-48c5b98d78c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.117266 Sep 23 03:16:06.885649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 260/526] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:06 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:07.897805 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:07.898901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:07.905374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:07.905885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:07.906761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:07.907255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:07.995019 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3060c9c3-5ba9-40bf-8c7b-096d5a2cb6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.101585 Sep 23 03:16:07.998986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 267/527] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:07 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:09.007781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:09.008935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:09.016755 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:09.017969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:09.018926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:09.019451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:09.131796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b5b3770b-24c4-4e2d-9885-f32d4640d51d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.128408 Sep 23 03:16:09.135906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 261/528] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:09 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:10.143559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:10.144574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:10.151234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:10.151675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:10.152430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:10.152881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:10.247802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-042c8e5b-43ec-4b2d-acbb-418e2c990ac6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.108078 Sep 23 03:16:10.248642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 268/529] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:10 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:10.779233 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:10.780383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:10.787340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:10.787789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:10.788581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:10.789021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:10.813119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'flavor' on Instance uuid 97ba4276-abfb-4947-920f-a0cc8dffab54 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:11.260192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:11.261329 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:11.267806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:11.268897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:11.269653 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:11.270087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:11.305051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e9d8f546-d44c-4835-a68a-4a40e15db483 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action" status: 200 len: 32 microversion: 2.1 time: 0.529874 Sep 23 03:16:11.305698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 262/530] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:16:10 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:16:11.314642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:11.315815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:11.324387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:11.324990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:11.325687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:11.334723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:11.370520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ba2baafa-d14e-4b24-b8cb-afd4bf0766fb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.114257 Sep 23 03:16:11.374457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 269/531] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:11 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:11.479639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:11.489283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6c0cd34b-4978-42a5-b95b-a3208b9bded2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.178346 Sep 23 03:16:11.490297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 263/532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:11 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:12.383504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:12.384516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:12.390944 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:12.391386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:12.392141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:12.392596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:12.479210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f221783b-cdf6-463b-ab21-6d1e8361d7aa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.099983 Sep 23 03:16:12.479919 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 270/533] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:12 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:12.506970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:12.507580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:12.513735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:12.514174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:12.514933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:12.515358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:12.664121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:12.672140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-66f63cbd-c61e-4b62-b222-4153fdb97e22 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.169331 Sep 23 03:16:12.672739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 264/534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:12 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:13.491679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:13.492842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:13.499212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:13.499637 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:13.500396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:13.500841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:13.592011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-decb78e6-86ff-4476-ae68-88fcbec99bdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.104310 Sep 23 03:16:13.592693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 271/535] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:13 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:13.690032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:13.690630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:13.697106 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:13.697542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:13.698517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:13.698955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:13.826964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:13.835177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b35c601a-b28b-4317-a96a-4058eee1e781 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.148869 Sep 23 03:16:13.835767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 265/536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:13 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:14.604302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:14.605317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:14.612032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:14.612468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:14.613234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:14.613659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:14.711948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0f6fd944-a677-45d1-98ed-ec12ae783f1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.111655 Sep 23 03:16:14.712431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 272/537] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:14 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:14.851545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:14.852151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:14.858740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:14.859181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:14.859979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:14.860413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:14.981775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:14.989808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d28e5d0b-51bb-4686-8658-bf91ce3ee062 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.141988 Sep 23 03:16:14.990386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 266/538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:14 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:15.724906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:15.727331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:15.739170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:15.739587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:15.740356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:15.740807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:15.837191 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1b423d07-6113-42c0-beaa-5601e94ed3d8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.116535 Sep 23 03:16:15.838047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 273/539] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:15 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:16.005623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:16.006232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:16.011992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:16.012436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:16.013224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:16.013656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:16.141383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:16.149722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-815a898d-b72a-44dc-99b0-4e92f15888b8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.147842 Sep 23 03:16:16.150293 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 267/540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:16 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:16.849038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:16.850168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:16.856638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:16.857087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:16.858099 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:16.858527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:16.971695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-341b4d7e-e245-4045-8a10-9b97e7eb9b0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.126743 Sep 23 03:16:16.975638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 274/541] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:16 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:17.166781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:17.167497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:17.184534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:17.184962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:17.185758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:17.186185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:17.341748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:17.349544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-991ee33a-241d-4d28-b17d-c2d53f59b20e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.186344 Sep 23 03:16:17.350110 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 268/542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:17 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:17.985219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:17.986996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:17.993837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:17.994283 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:17.995065 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:17.995488 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:18.090189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-47ed7f0b-7db1-4fba-88c9-8b90c77faa2d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.109978 Sep 23 03:16:18.092190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 275/543] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:17 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:18.373800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:18.373800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:18.385182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:18.385642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:18.386434 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:18.386865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:18.589402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:18.598149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-53f47a6d-ba8b-4797-ad70-58a4d6ef87fa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.234156 Sep 23 03:16:18.598762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 269/544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:18 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:19.102690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:19.104625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:19.112779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.113568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.114761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.115357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.219917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-df2a27f3-35e6-433f-888f-5372787d826c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.121460 Sep 23 03:16:19.223789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 276/545] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:19 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:19.502114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def6f587-71ec-44cd-985b-0d9cd686e357"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:19.503229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:19.509379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.509846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.510601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.511119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.591736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Invalid volume: volume def6f587-71ec-44cd-985b-0d9cd686e357 is already attached to instances: f1794ea1-9fe8-477d-9b84-69b84a923ec2 Sep 23 03:16:19.591736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 400 to user: Invalid volume: volume def6f587-71ec-44cd-985b-0d9cd686e357 is already attached to instances: f1794ea1-9fe8-477d-9b84-69b84a923ec2 {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:16:19.592235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5702a533-6e83-44e7-9b7e-9113d132d8fe tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094003 Sep 23 03:16:19.592888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 270/546] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:16:19 2021] POST /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:16:19.616687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:19.617517 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:19.624410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.637930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.637930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.637930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.662010 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:19.662493 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:19.668623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.677474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.677474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:19.677474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:19.763668 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:19.764211 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'services' on Instance uuid f1794ea1-9fe8-477d-9b84-69b84a923ec2 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:19.772058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e64da111-7191-46d5-bcb5-171b879e430b tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.160551 Sep 23 03:16:19.783025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 277/547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:19 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:20.025854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-40fe0045-effc-41b6-8cfe-44328bf13369 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments/def6f587-71ec-44cd-985b-0d9cd686e357" status: 202 len: 0 microversion: 2.1 time: 0.367959 Sep 23 03:16:20.026469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 271/548] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:16:19 2021] DELETE /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments/def6f587-71ec-44cd-985b-0d9cd686e357 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:20.034662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:20.035815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:20.041759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.042192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.042932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.043351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.072543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c4a924b4-bb02-4008-9bd3-178ea5f51cba tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Sep 23 03:16:20.073016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 278/549] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:20 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:20.231609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:20.232876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:20.238715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.239500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.239894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.240295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.366563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-702b8150-b11c-4a40-a42d-20f83e62b343 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.138736 Sep 23 03:16:20.367176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 272/550] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:20 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:20.789674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:20.790301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:20.796562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.797008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.797762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:20.798195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:20.921212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:20.929482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0219ced4-c362-45c9-896d-2ecfe343e05d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1568 microversion: 2.1 time: 0.143502 Sep 23 03:16:20.929977 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 279/551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:20 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:21.084292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:21.085361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:21.091783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.092258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:21.093067 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.093501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:21.122879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-80aa72b5-b5de-4239-bc56-a510b7b60fef tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Sep 23 03:16:21.123432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 273/552] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:21 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:21.378867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:21.379917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:21.386857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.393392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:21.393392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.393392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:21.487415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-42d962ad-590e-4ba9-b0cc-0a4890ecf9db tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.112160 Sep 23 03:16:21.488082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 280/553] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:21 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:21.945662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:21.946286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:21.952017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.952461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:21.953279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:21.953733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.071335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:22.079264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2f529d9e-34a9-4aab-8180-1501a79ce929 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1548 microversion: 2.1 time: 0.137287 Sep 23 03:16:22.079858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 274/554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:21 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:22.097088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:22.097662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:22.104014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.104448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.107070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.107070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.133341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:22.134257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:22.140542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.143634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.143634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.143634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.176376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9fafb830-4d8d-4bb7-a8fd-e08c595b285e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Sep 23 03:16:22.176825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 275/555] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:22 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:22.238999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] HTTP exception thrown: Cannot 'detach_volume' instance 97ba4276-abfb-4947-920f-a0cc8dffab54 while it is in vm_state rescued Sep 23 03:16:22.239586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Returning 409 to user: Cannot 'detach_volume' instance 97ba4276-abfb-4947-920f-a0cc8dffab54 while it is in vm_state rescued {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:16:22.240398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8af5ecc3-d03e-4b1b-89aa-4421369f86e6 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments/24464e14-bad1-43eb-869d-22578bec7848" status: 409 len: 152 microversion: 2.1 time: 0.148049 Sep 23 03:16:22.241177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 281/556] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:16:22 2021] DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments/24464e14-bad1-43eb-869d-22578bec7848 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:16:22.249344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:22.249877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:22.255766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.256212 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.257062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.257491 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.486411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-85ac103e-d78b-4a5e-afef-3b4422bda0b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action" status: 202 len: 0 microversion: 2.1 time: 0.239524 Sep 23 03:16:22.490656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 276/557] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:16:22 2021] POST /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:22.496751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:22.497352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:22.499348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:22.500408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:22.504796 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.506448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.506448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.506448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.507748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.508465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.509370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:22.509853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:22.630188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:22.632890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c7e60c9b-4f06-4ff0-99a6-a7864c5f26fd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.137411 Sep 23 03:16:22.635066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 277/558] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:22 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:22.638580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-38aaa27a-3f23-49a5-a352-91bb80bc8895 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1556 microversion: 2.1 time: 0.147112 Sep 23 03:16:22.639195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 282/559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:22 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:23.024855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-489688152", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "0b85a16e-dcb5-4356-9889-fba810265f88"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:23.077824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] validate_networks() for [('0b85a16e-dcb5-4356-9889-fba810265f88', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:16:23.186596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:23.187513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:23.195149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.195149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.195507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.195936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.225819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-12595187-a715-48ea-a575-02aa3c9c0361 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042939 Sep 23 03:16:23.226379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 283/560] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:23 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:16:23.398081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-139316845", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "803c4c70-2ff9-4ddc-a896-3501f0b2a0a2"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:23.437866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:16:23.438364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:16:23.438727 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:16:23.439123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:16:23.440203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:16:23.449336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.449769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.450546 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.450967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.456718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] validate_networks() for [('803c4c70-2ff9-4ddc-a896-3501f0b2a0a2', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:16:23.471171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Getting quotas for project 5939c75066cc45d8bfb227964729f041. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:16:23.475088 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Getting quotas for user f14f97daab1d499b8027de90847e6757 and project 5939c75066cc45d8bfb227964729f041. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:16:23.486020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:16:23.488971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:16:23.588142 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e849db14-3fa8-4196-9dd8-71574c353f74 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567208 Sep 23 03:16:23.589139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 278/561] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:16:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:16:23.598751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f7a2e0c6-e608-4de8-9ca2-5482a67716a5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:23.599361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f7a2e0c6-e608-4de8-9ca2-5482a67716a5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:23.660052 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f7a2e0c6-e608-4de8-9ca2-5482a67716a5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:23.675777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f7a2e0c6-e608-4de8-9ca2-5482a67716a5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1213 microversion: 2.1 time: 0.080300 Sep 23 03:16:23.676678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 279/562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:23 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:23.691393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:23.692364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:23.703504 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.703969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.704761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.705190 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.851779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2a4104bc-b313-4bb1-a151-89e9785baa82 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.164585 Sep 23 03:16:23.852682 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 280/563] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:23 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:23.858026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:23.858708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:23.859922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:16:23.860547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:16:23.861017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:16:23.861415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:16:23.862447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:16:23.865993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.866507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.867273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.867695 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.871829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.872268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.873116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:23.873535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:23.891544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:16:23.895459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Getting quotas for user 36893da01a1845f5af4921a298abb9eb and project 3a0db8b321a54de5ae011d51e6e69a58. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:16:23.906338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:16:23.909187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:16:23.999495 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:24.008273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bfaee777-17ea-45b8-99da-8d7a25f5f975 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1556 microversion: 2.1 time: 0.154458 Sep 23 03:16:24.010077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 281/564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:23 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:24.010943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-246c6c90-fd29-4834-9995-df5299cb464f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616708 Sep 23 03:16:24.011733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 284/565] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:16:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 03:16:24.023344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9b5af89e-b9db-4321-bc88-a33b90af776e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:24.024050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9b5af89e-b9db-4321-bc88-a33b90af776e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:24.077433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9b5af89e-b9db-4321-bc88-a33b90af776e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:24.084705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9b5af89e-b9db-4321-bc88-a33b90af776e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1217 microversion: 2.1 time: 0.067116 Sep 23 03:16:24.085273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 282/566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:24 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:24.368237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:16:24.368604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:16:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:16:24.692843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:24.693455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:24.699540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:24.699982 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:24.700761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:24.701195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:24.759995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:24.767189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-dd62516c-ec1a-4280-bf75-0b4d5b4716f4 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1217 microversion: 2.1 time: 0.078085 Sep 23 03:16:24.768056 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 285/567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:24 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:24.864418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:24.865363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:24.872057 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:24.872539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:24.873375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:24.873814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:24.959856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-116f9b98-460c-4b5a-8e1e-64ea38317c37 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.099589 Sep 23 03:16:24.960504 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 283/568] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:24 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:25.026816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:25.027410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:25.033135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.034517 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.035222 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.035648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.102969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:25.103665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:25.110347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.110796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.111566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.111996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.183604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:25.188158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:25.192750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ab63b3b0-fc77-4c4b-89a6-4dd0bb458e49 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1556 microversion: 2.1 time: 0.169517 Sep 23 03:16:25.193321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 286/569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:25 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:25.202103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-611c7b4a-b9e3-424f-8ca7-aca9f94cc596 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1221 microversion: 2.1 time: 0.103152 Sep 23 03:16:25.202662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 284/570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:25 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:25.785760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:25.786365 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:25.792298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.792779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.793534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.793964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.854080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:25.861461 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-090e0d2c-6e63-405c-a805-5ebda98bb928 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1265 microversion: 2.1 time: 0.080050 Sep 23 03:16:25.864272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 287/571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:25 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:25.976338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:25.977273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:25.983277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.983707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:25.984447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:25.984895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.211048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:26.211787 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:26.217934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.218382 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.219144 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.219574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.241743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-53ce1651-e1f3-4ba6-9c95-8131ecd7619a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.268948 Sep 23 03:16:26.242389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 285/572] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:25 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:26.247370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:26.248044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:26.255050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.255487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.256245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.256701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.320523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:26.328260 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0a40f086-f184-4a22-b863-4ba2930f4de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1213 microversion: 2.1 time: 0.084721 Sep 23 03:16:26.329058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 286/573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:26 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:26.347870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:26.355467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-afe4d8f0-0d4a-4813-bce4-e68d4b746caa tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1556 microversion: 2.1 time: 0.149104 Sep 23 03:16:26.358693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 288/574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:26 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:26.878361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:26.879172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:26.885136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.885574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.886329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:26.886751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:26.951119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:26.958271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ba552e31-1305-499c-bcc2-c3b304247bc3 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1271 microversion: 2.1 time: 0.083605 Sep 23 03:16:26.958825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 287/575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:26 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:27.253205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:27.254271 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:27.260262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.262021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.262021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.262249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.345711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:27.346896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:27.351914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e1119a07-742d-4f31-9149-40859f8dffd9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.102381 Sep 23 03:16:27.353171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 289/576] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:27 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:27.356591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.364369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.364369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.364369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.374329 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:27.375131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:27.381481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.382033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.382868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.383633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.445298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:27.454687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-657c4c8b-4358-4983-b3d2-cb38dd1a1388 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1277 microversion: 2.1 time: 0.112499 Sep 23 03:16:27.465757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 288/577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:27 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:27.528054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:27.545874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c608faa9-1803-4b21-b051-b93d058a4b2f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1562 microversion: 2.1 time: 0.175663 Sep 23 03:16:27.555956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 290/578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:27 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:27.624583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:27.625188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:27.632662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.633941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.635659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.636192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.741062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'services' on Instance uuid 97ba4276-abfb-4947-920f-a0cc8dffab54 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:27.981458 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:27.982178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:27.989005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.989483 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:27.990273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:27.990773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.039793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7b92edd3-1fa6-4350-bcf0-0bc9eaaa57b7 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments/24464e14-bad1-43eb-869d-22578bec7848" status: 202 len: 0 microversion: 2.1 time: 0.419784 Sep 23 03:16:28.041016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 289/579] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:16:27 2021] DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments/24464e14-bad1-43eb-869d-22578bec7848 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:28.052718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:28.071456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:28.071456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.071456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.071456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.071879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.102295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d29eddb-3a75-4e19-a47f-974bb19050c2 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054870 Sep 23 03:16:28.102893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 290/580] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:28 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:28.134151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:28.141693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f470c52a-8b55-47c5-a8c2-7b31e5f2127a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.163992 Sep 23 03:16:28.142253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 291/581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:27 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:28.366433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:28.368034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:28.374038 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.379676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.379676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.379676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.467265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-10cee04f-7d15-4148-a4df-832cf23648da tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.106779 Sep 23 03:16:28.468265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 291/582] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:28 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:28.474275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:28.474882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:28.481274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.482055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.487392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:28.487916 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:28.614294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:28.626452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-561361d5-4405-40ac-a908-8f12128fac97 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.157479 Sep 23 03:16:28.627863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 292/583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:28 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:29.114612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:29.115748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:29.122156 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.122598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.123369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.123803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.156829 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7d3820ac-b527-478d-83f7-5fa4e8424da3 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046855 Sep 23 03:16:29.157611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 292/584] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:29 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:29.164513 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-6145e879-2cbe-410b-a4ac-cd333501f8d5 req-69db1034-8350-4732-ba8d-5429c3debe2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b71f99-c432-4dbb-a61c-8b42dc97b750", "tag": "fb8dc381-37eb-4a7f-b47b-e58cf51ebca3"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:29.166616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:29.166616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:16:29.170255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:29.171762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:29.173676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-6145e879-2cbe-410b-a4ac-cd333501f8d5 req-69db1034-8350-4732-ba8d-5429c3debe2b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.174678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-6145e879-2cbe-410b-a4ac-cd333501f8d5 req-69db1034-8350-4732-ba8d-5429c3debe2b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.179317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.180037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.180937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.181454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.186415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-6145e879-2cbe-410b-a4ac-cd333501f8d5 req-69db1034-8350-4732-ba8d-5429c3debe2b service nova] Creating event network-changed:fb8dc381-37eb-4a7f-b47b-e58cf51ebca3 for instance 45b71f99-c432-4dbb-a61c-8b42dc97b750 on hv-cinder-76845 Sep 23 03:16:29.191202 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-6145e879-2cbe-410b-a4ac-cd333501f8d5 req-69db1034-8350-4732-ba8d-5429c3debe2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030338 Sep 23 03:16:29.202543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 293/585] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:29.311223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:29.323003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4982ce45-abab-4140-827c-f3172c3da0ea tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.163232 Sep 23 03:16:29.323003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 293/586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:29 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:29.479886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:29.481109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:29.487828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.488304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.489064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.489493 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.598560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4719b21a-92a7-4596-82bd-f8094da0dc95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.122652 Sep 23 03:16:29.599283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 294/587] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:29 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:29.649064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:29.649667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:29.666487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.666487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.666487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:29.666487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:29.791751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:29.800001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-85f3a958-1161-4fa5-8a56-806d5959c406 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.155118 Sep 23 03:16:29.800595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 294/588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:29 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:30.168993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:30.170004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:30.176406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.176874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.177712 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.178134 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.208352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a98442af-65f4-4735-b15a-c8dda007f50f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043694 Sep 23 03:16:30.208937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 295/589] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:30 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:16:30.335792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:30.336479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:30.342927 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.345715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.347064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.347588 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.474427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:30.482926 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f18eb94a-8b78-4e9b-afd9-0116492812e5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.150899 Sep 23 03:16:30.483416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 295/590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:30 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:30.611320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:30.612961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:30.618621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.619066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.619828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.620263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.817090 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:30.817857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:30.823931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.824365 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.825149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:30.825582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:30.947756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:30.954899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2167ae83-da94-4d99-9e18-300d22562429 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.142058 Sep 23 03:16:30.955987 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 296/591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:30 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:31.215142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-d13162e1-4bc0-4697-b5c3-1bc03e786700 req-81ffee2c-0c60-4267-a05d-b6c1ff4ac9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee980ba2-a3de-4ed0-b4bf-f60fa358522b", "tag": "9f6ade92-6477-4a52-8c99-d80aa360d9ac"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:31.216725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:31.216725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:16:31.223967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d13162e1-4bc0-4697-b5c3-1bc03e786700 req-81ffee2c-0c60-4267-a05d-b6c1ff4ac9e9 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:31.224400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d13162e1-4bc0-4697-b5c3-1bc03e786700 req-81ffee2c-0c60-4267-a05d-b6c1ff4ac9e9 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:31.235213 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-d13162e1-4bc0-4697-b5c3-1bc03e786700 req-81ffee2c-0c60-4267-a05d-b6c1ff4ac9e9 service nova] Creating event network-changed:9f6ade92-6477-4a52-8c99-d80aa360d9ac for instance ee980ba2-a3de-4ed0-b4bf-f60fa358522b on hv-cinder-76845 Sep 23 03:16:31.239958 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-d13162e1-4bc0-4697-b5c3-1bc03e786700 req-81ffee2c-0c60-4267-a05d-b6c1ff4ac9e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028431 Sep 23 03:16:31.246629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 297/592] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:31.323534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bea1b867-b4cd-42d8-9322-8eabf27dbe14 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.715945 Sep 23 03:16:31.324178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 296/593] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:30 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:31.499594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:31.500439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:31.507934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:31.508379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:31.509214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:31.509645 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:31.640961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:31.649048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-02d95251-1589-44a9-ae48-f470849b307f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.153563 Sep 23 03:16:31.658942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 298/594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:31 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:31.972175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:31.972909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:31.979621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:31.980069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:31.980876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:31.981307 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:32.103896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:32.111287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ab4d762d-5075-42e7-8073-15f35dc74de1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.143081 Sep 23 03:16:32.112170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 297/595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:31 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:32.335893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:32.336814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:32.342571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:32.343127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:32.343913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:32.344334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:32.439060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-50afc898-3177-4a5f-b336-5b1366a97b7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.106776 Sep 23 03:16:32.440179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 299/596] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:32 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:32.665344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:32.665947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:32.671658 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:32.672094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:32.672874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:32.673305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:32.794930 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:32.802700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bf1c203b-5dcc-439b-8250-1675bb67b710 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.141047 Sep 23 03:16:32.803256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 298/597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:32 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:33.058961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:33.059540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:33.066509 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.066951 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.067705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.068161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.092301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:16:33.128614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:33.129216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:33.135448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.135884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.136665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.137130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.255981 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:33.263035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5d10ddaa-2a9f-4068-a32f-f13c2b7b5c8c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.138977 Sep 23 03:16:33.263612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 299/598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:33 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:33.356761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-31a73f1d-aded-4ead-9c54-6283f9b34fda tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 204 len: 0 microversion: 2.1 time: 0.301354 Sep 23 03:16:33.357610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 300/599] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:16:33 2021] DELETE /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:16:33.365261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:33.365886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:33.372759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.373952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.374073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.374400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.451643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:33.452730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:33.459127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.459572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.460336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.460798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.496448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:33.503718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3035dcaa-fb36-457a-9934-e44d327e5f37 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1508 microversion: 2.1 time: 0.142133 Sep 23 03:16:33.504270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 300/600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:33 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:33.569181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-128f6af1-81eb-43cd-874a-abd72481fc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.121377 Sep 23 03:16:33.569818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 301/601] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:33 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:33.819828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:33.820436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:33.826262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.826704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.827454 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:33.827884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:33.948778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:33.956386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e44bf379-1cf5-4ced-a69e-5ac92af15eb2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.140394 Sep 23 03:16:33.956978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 301/602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:33 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:34.280571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:34.281271 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:34.287729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.288169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.288962 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.289389 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.411181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:34.418543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9eced13c-f136-478c-bc33-afc0fa1f70bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.142022 Sep 23 03:16:34.419169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 302/603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:34 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:34.519696 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:34.520317 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:34.526219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.526667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.527425 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.527858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.585841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:34.586746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:34.592363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.592840 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.593581 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.594002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.652191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:34.660059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c86c3c15-1a31-45db-a079-d1afbf8c3e1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1508 microversion: 2.1 time: 0.143972 Sep 23 03:16:34.660646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 302/604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:34 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:34.698457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9919fdf3-d96f-4641-b6a4-7df5c3ccdf12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.111358 Sep 23 03:16:34.698457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 303/605] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:34 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:34.973204 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:34.973737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:34.979326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.979764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:34.980533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:34.980962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.100466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:35.107888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8f3be3f7-7930-4b33-b7ef-0daa4c6a011e tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.138725 Sep 23 03:16:35.108447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 303/606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:34 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:35.435993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:35.436758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:35.443641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.444084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.444872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.445306 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.571710 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:35.578930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a9a47f00-5d62-48ab-b0fa-dcf093a5a6d3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.147089 Sep 23 03:16:35.579492 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 304/607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:35 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:35.676943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:35.677481 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:35.683604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.684043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.684827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.685254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.707441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:35.708553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:35.715853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.715853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.716097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:35.716613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:35.814260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b7ea7a99-6126-4b7d-aa4a-40951532dd40 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.109509 Sep 23 03:16:35.820194 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 305/608] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:35 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:35.825979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:35.833264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-592fdab8-5268-44e0-8942-9948c4dc434f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1508 microversion: 2.1 time: 0.160511 Sep 23 03:16:35.844925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 304/609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:35 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:36.124967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:36.125666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:36.133268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.133704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.134465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.134884 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.258694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:36.265974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c01355c5-ece8-4185-ab36-b6464367a82c tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.145137 Sep 23 03:16:36.266532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 306/610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:36 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:36.594927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:36.595574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:36.608572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.609241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.619645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.619645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.827297 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:36.828203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:36.834632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.835293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.836062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.836504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.839786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:36.848319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-193f80a5-524e-4eb4-b7cd-942f16a6fea9 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.256999 Sep 23 03:16:36.849041 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 305/611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:36 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:36.860139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:36.860935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:36.867326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.867764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.868721 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:36.869252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:36.993620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8d2b70db-1112-4a8c-afd0-eff91b04ec8b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 28742 microversion: 2.20 time: 0.169915 Sep 23 03:16:36.994303 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 307/612] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:36 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 28742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:37.083435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:37.090580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8e7a337a-89d6-419a-a398-54fecf5daaea tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1508 microversion: 2.1 time: 0.234362 Sep 23 03:16:37.094968 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 306/613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:36 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:37.283020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:37.287383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:37.290246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:37.290975 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:37.292119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:37.292772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:37.347285 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-e73da53f-e125-4c9b-ba7f-419ae1aad27a req-4df7125b-253a-4d96-aebf-bd2c5f7ff246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3e7808-544d-464f-a759-648393c4f9b8", "name": "network-vif-deleted", "tag": "91d8a60b-64c2-40d5-b3f2-d768b237086a"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:37.349232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:37.349232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:16:37.356198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e73da53f-e125-4c9b-ba7f-419ae1aad27a req-4df7125b-253a-4d96-aebf-bd2c5f7ff246 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:37.356913 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e73da53f-e125-4c9b-ba7f-419ae1aad27a req-4df7125b-253a-4d96-aebf-bd2c5f7ff246 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:37.371891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-e73da53f-e125-4c9b-ba7f-419ae1aad27a req-4df7125b-253a-4d96-aebf-bd2c5f7ff246 service nova] Creating event network-vif-deleted:91d8a60b-64c2-40d5-b3f2-d768b237086a for instance 2f3e7808-544d-464f-a759-648393c4f9b8 on hv-cinder-76845 Sep 23 03:16:37.380761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-e73da53f-e125-4c9b-ba7f-419ae1aad27a req-4df7125b-253a-4d96-aebf-bd2c5f7ff246 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036981 Sep 23 03:16:37.381443 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 307/614] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:37.430167 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:37.437694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-76ead803-6261-4ab7-ab7b-b1ff84b2d1d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.158844 Sep 23 03:16:37.438294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 308/615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:37 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:37.866511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:37.867468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:37.873523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:37.873960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:37.874714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:37.875145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:37.994885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:38.002334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c0b7566c-a656-4824-a500-82794c97d5e3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.139971 Sep 23 03:16:38.002882 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 308/616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:37 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:38.004716 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:38.005623 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:38.011350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.011789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.012558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.012980 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.109506 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:38.110027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:38.116193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.116691 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.117469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.117891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.147861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.148297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.148755 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'fault' on Instance uuid 2f3e7808-544d-464f-a759-648393c4f9b8 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:38.187032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:38.194716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-26d10356-8db0-4041-b8ee-9a8ab2c102a8 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 200 len: 1312 microversion: 2.1 time: 0.089192 Sep 23 03:16:38.195277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 309/617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:38 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:38.261454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-787f2c23-fe29-4d88-a329-915196224284 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 30007 microversion: 2.20 time: 0.260283 Sep 23 03:16:38.262092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 309/618] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:37 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 30007 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:38.454348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:38.455061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:38.461141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.461575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.462318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:38.462739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:38.583398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:38.590420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6f4c99a4-3cde-4eb5-b330-08ea2a63b5a2 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.139644 Sep 23 03:16:38.591008 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 310/619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:38 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:39.019760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:39.020856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.026927 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.027372 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.028132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.028595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.151440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:39.158559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fa350dcd-7a14-45ef-95f5-5c903064c22b tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.143390 Sep 23 03:16:39.159115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 310/620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:39 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:39.211198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:39.211860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 2f3e7808-544d-464f-a759-648393c4f9b8] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.217571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.218006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.218753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.219177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.233253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] HTTP exception thrown: Instance 2f3e7808-544d-464f-a759-648393c4f9b8 could not be found. Sep 23 03:16:39.233855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Returning 404 to user: Instance 2f3e7808-544d-464f-a759-648393c4f9b8 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:16:39.234687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b8a5c94c-afd5-4559-827f-754e087df175 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8" status: 404 len: 111 microversion: 2.1 time: 0.027136 Sep 23 03:16:39.235203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 311/621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:39 2021] GET /compute/v2.1/servers/2f3e7808-544d-464f-a759-648393c4f9b8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:16:39.243729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:39.244218 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.250056 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.250441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.251192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.251619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.273162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:39.274287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.278166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:16:39.280903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.281441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.282297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.282956 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.385261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e69c411f-84df-4ffe-9376-e36485647d36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 31505 microversion: 2.20 time: 0.115847 Sep 23 03:16:39.385896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 312/622] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:39 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 31505 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:39.607155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:39.608151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.615078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.615521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.616280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.616751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.625586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-15518791-ffa8-4304-9fb9-e78aaffa58a9 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 204 len: 0 microversion: 2.1 time: 0.385203 Sep 23 03:16:39.626176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 311/623] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:16:39 2021] DELETE /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:16:39.634334 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:39.635017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:39.640808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.641255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.642009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:39.642436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:39.738259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:39.745941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0452d906-fd4e-47fe-9df0-f7b5cbabc3e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.142758 Sep 23 03:16:39.746511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 313/624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:39 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:39.767557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:39.773177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1f81734d-b0c5-4936-aad9-bdadbc10e941 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.142635 Sep 23 03:16:39.773725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 312/625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:39 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:40.175800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:40.176399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:40.182168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.182603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.183404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.183826 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.227611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-97df5d30-12f6-4e69-b6cc-ba56c8ed0d31 req-ec92a69e-2067-4a54-8606-c82d480fbcad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b71f99-c432-4dbb-a61c-8b42dc97b750", "name": "network-vif-plugged", "status": "completed", "tag": "fb8dc381-37eb-4a7f-b47b-e58cf51ebca3"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:40.229364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:40.229364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:16:40.237799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-97df5d30-12f6-4e69-b6cc-ba56c8ed0d31 req-ec92a69e-2067-4a54-8606-c82d480fbcad service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.238321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-97df5d30-12f6-4e69-b6cc-ba56c8ed0d31 req-ec92a69e-2067-4a54-8606-c82d480fbcad service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.249327 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-97df5d30-12f6-4e69-b6cc-ba56c8ed0d31 req-ec92a69e-2067-4a54-8606-c82d480fbcad service nova] Creating event network-vif-plugged:fb8dc381-37eb-4a7f-b47b-e58cf51ebca3 for instance 45b71f99-c432-4dbb-a61c-8b42dc97b750 on hv-cinder-76845 Sep 23 03:16:40.254744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-97df5d30-12f6-4e69-b6cc-ba56c8ed0d31 req-ec92a69e-2067-4a54-8606-c82d480fbcad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030760 Sep 23 03:16:40.255319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 313/626] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:40.307778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:40.315526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-dc1ab910-0783-402b-9d90-ec1f47af2015 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.144292 Sep 23 03:16:40.316144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 314/627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:40 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:40.397525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:40.398842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:40.404890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.405340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.406097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.406524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.508636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d1ba7025-a619-48ab-86bc-b781d19c3688 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 32580 microversion: 2.20 time: 0.115083 Sep 23 03:16:40.509356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 314/628] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:40 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 32580 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:40.764045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:40.764681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:40.772246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.772715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.773733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.774160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.800088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:40.800816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:40.817591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.818250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.819207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:40.819788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:40.941806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:40.945786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:40.949259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a5be919b-9a86-4d4d-9d78-bd6e8165fc1e tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.153209 Sep 23 03:16:40.949829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 315/629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:40 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:40.953088 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-018aa2b2-afad-438a-a6cd-805ee8fa73cd tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.193698 Sep 23 03:16:40.953639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 315/630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:40 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:41.332994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:41.333603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:41.339382 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.339823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.340609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.341042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.468026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:41.475375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ecf4de04-1b3b-4262-80a5-cf4806bbd4f3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.146665 Sep 23 03:16:41.476033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 316/631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:41 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:41.520433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:41.521396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:41.527176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.527628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.528396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.528854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.723532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-178a78b4-443d-408e-abaa-a37ddfa26d24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 33322 microversion: 2.20 time: 0.206683 Sep 23 03:16:41.724213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 316/632] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:41 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 33322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:41.966751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:41.967285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:41.970478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:41.971724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:41.973999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.974443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.975199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.975626 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.978556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.979083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:41.979898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:41.980373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:42.098642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:42.105972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4909959f-a441-473d-bf66-7e3d39436f39 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.143009 Sep 23 03:16:42.106572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 317/633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:41 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:42.129661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:42.136781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c50c1ef5-837d-4157-ac85-e6764c231678 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1313 microversion: 2.1 time: 0.170393 Sep 23 03:16:42.137330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 317/634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:41 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:42.268911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-775e2340-0f6f-41e1-b3b6-e55ec277ddee req-6a4e128b-0413-42c7-a336-fd7cdd4f6132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee980ba2-a3de-4ed0-b4bf-f60fa358522b", "name": "network-vif-plugged", "status": "completed", "tag": "9f6ade92-6477-4a52-8c99-d80aa360d9ac"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:42.270444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:42.270444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:16:42.277549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-775e2340-0f6f-41e1-b3b6-e55ec277ddee req-6a4e128b-0413-42c7-a336-fd7cdd4f6132 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:42.278140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-775e2340-0f6f-41e1-b3b6-e55ec277ddee req-6a4e128b-0413-42c7-a336-fd7cdd4f6132 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:42.288750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-775e2340-0f6f-41e1-b3b6-e55ec277ddee req-6a4e128b-0413-42c7-a336-fd7cdd4f6132 service nova] Creating event network-vif-plugged:9f6ade92-6477-4a52-8c99-d80aa360d9ac for instance ee980ba2-a3de-4ed0-b4bf-f60fa358522b on hv-cinder-76845 Sep 23 03:16:42.293534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-775e2340-0f6f-41e1-b3b6-e55ec277ddee req-6a4e128b-0413-42c7-a336-fd7cdd4f6132 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028308 Sep 23 03:16:42.294109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 318/635] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:42.492210 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:42.492857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:42.499159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:42.499497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:42.500334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:42.500917 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:42.643551 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:42.651798 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2d218cbe-03b7-4c22-bd44-aa949bfb27a5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.163260 Sep 23 03:16:42.652654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 318/636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:42 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:42.736004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:42.737168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:42.743381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:42.743828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:42.744627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:42.745063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.123272 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:43.123793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:43.130765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.131205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.131964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.132387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.251252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:43.259053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-774dad74-854b-4948-8fa1-f1b47630ac57 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.139585 Sep 23 03:16:43.259562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 319/637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:43 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:43.263808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:43.264402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:43.274331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.274331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.274331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.274331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.323447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-83f4e0b0-9576-4d8a-85ec-a03a88c92487 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 34288 microversion: 2.20 time: 0.591534 Sep 23 03:16:43.324093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 319/638] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:42 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 34288 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:43.393843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:43.401097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-246a8a43-5d2b-4c91-823a-02efeb9221f7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1497 microversion: 2.1 time: 0.140576 Sep 23 03:16:43.401656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 320/639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:43 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:43.669469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:43.670156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:43.677149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.677606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.678368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:43.678796 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:43.805546 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:43.813026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8473fba1-291d-417f-977c-6a66c0cd5d55 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.147902 Sep 23 03:16:43.813595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 320/640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:43 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:44.274792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:44.275447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:44.281696 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.282321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.283077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.283507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.335768 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:44.336977 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:44.344105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.344105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.344836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.345331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.409590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:44.414849 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ed258929-10e6-4785-8a3c-8eda43334560 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.143721 Sep 23 03:16:44.415410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 321/641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:44 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:44.463530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:44.464019 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:44.469773 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.470209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.474705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.474705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.496257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:16:44.540604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34d457f4-eaf7-4cba-9a4e-57bd2f591bef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 34917 microversion: 2.20 time: 0.208472 Sep 23 03:16:44.544516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 321/642] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:44 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 34917 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:44.834079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:44.836728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:44.843239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.843683 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.844449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.844896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.963327 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2043e5fd-ef93-44ae-baed-1b181d6ca7d5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 204 len: 0 microversion: 2.1 time: 0.503077 Sep 23 03:16:44.964255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 322/643] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:16:44 2021] DELETE /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:16:44.972242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:44.972963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:44.974128 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:44.978783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.979216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.979970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:44.980389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:44.982864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1811158d-818d-4db2-93c3-29aa9f9ca5bf tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1317 microversion: 2.1 time: 0.153008 Sep 23 03:16:44.983585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 322/644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:44 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:45.110555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:45.117796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ace66beb-9ed3-40bf-8422-d13e65c805df tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1503 microversion: 2.1 time: 0.149484 Sep 23 03:16:45.118357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 323/645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:44 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:45.430880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:45.431490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:45.437207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:45.437657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:45.438417 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:45.438869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:45.552765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:45.554455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:45.559880 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:45.560416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:45.561277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:45.565052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:45.568352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:45.575149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9323c47e-f7e7-4eac-abaa-7ec3af0a2f1f tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.147774 Sep 23 03:16:45.586544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 323/646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:45 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:45.685842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-553a3c88-c512-4413-a774-075121fa6786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 35645 microversion: 2.20 time: 0.137164 Sep 23 03:16:45.686480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 324/647] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:45 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 35645 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:45.999054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:45.999718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:46.005752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.006183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.006939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.007343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.125855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:46.133187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a3d70cfe-0f12-467c-8d97-79b1344fa502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1505 microversion: 2.1 time: 0.137839 Sep 23 03:16:46.133752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 324/648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:45 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1505 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:46.135335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:46.136061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:46.143174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.143611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.144367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.144853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.264620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:46.272232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9cb39214-787f-4ebb-9116-0e7f12e6c716 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1503 microversion: 2.1 time: 0.140862 Sep 23 03:16:46.272810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 325/649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:46 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1503 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:46.597268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:46.598142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:46.610677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.617198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.617198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.617198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.698494 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:46.699443 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:46.705936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.706374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.707220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:46.707801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:46.742678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:46.749892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9a2e17bc-a54b-4a85-89a7-a1a136442ca1 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.162649 Sep 23 03:16:46.750434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 325/650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:46 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:46.913785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ddcf5f13-b442-4837-b292-9a0f4785f10a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 36646 microversion: 2.20 time: 0.219229 Sep 23 03:16:46.914331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 326/651] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:46 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 36646 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:47.288928 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:47.289535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:47.295324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.295765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.296541 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.296972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.414815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:47.422104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-56febb69-7fc4-48ac-968a-36bb84804999 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1503 microversion: 2.1 time: 0.136840 Sep 23 03:16:47.422720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 326/652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:47 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1503 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:47.766967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:47.768154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:47.774681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.775121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.775879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.776306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.926316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:47.927279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:47.934066 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.934512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.935270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.935689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:47.967558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:47.975525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-18604fcc-8d94-4067-90eb-fa22a9074514 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.212639 Sep 23 03:16:47.976070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 327/653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:47 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:47.980399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-eb4ddf68-e81e-4b69-bebd-15cb9cb064cf req-dcab0d02-b077-4bda-a155-1569280fe3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b71f99-c432-4dbb-a61c-8b42dc97b750", "name": "network-vif-deleted", "tag": "fb8dc381-37eb-4a7f-b47b-e58cf51ebca3"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:47.981894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:47.981894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:16:47.988942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-eb4ddf68-e81e-4b69-bebd-15cb9cb064cf req-dcab0d02-b077-4bda-a155-1569280fe3f3 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:47.989369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-eb4ddf68-e81e-4b69-bebd-15cb9cb064cf req-dcab0d02-b077-4bda-a155-1569280fe3f3 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.000775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-eb4ddf68-e81e-4b69-bebd-15cb9cb064cf req-dcab0d02-b077-4bda-a155-1569280fe3f3 service nova] Creating event network-vif-deleted:fb8dc381-37eb-4a7f-b47b-e58cf51ebca3 for instance 45b71f99-c432-4dbb-a61c-8b42dc97b750 on hv-cinder-76845 Sep 23 03:16:48.005828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-eb4ddf68-e81e-4b69-bebd-15cb9cb064cf req-dcab0d02-b077-4bda-a155-1569280fe3f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028551 Sep 23 03:16:48.006640 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 328/654] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:48.238991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fe3f3850-6fd7-4c19-ba12-1af71c8ec14d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 37690 microversion: 2.20 time: 0.316959 Sep 23 03:16:48.239823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 327/655] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:47 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 37690 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:48.439061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:48.439824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:48.445989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.446442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.447213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.447647 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.480371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.480850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.481464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lazy-loading 'fault' on Instance uuid 45b71f99-c432-4dbb-a61c-8b42dc97b750 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:48.526662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:48.534710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d1b5108c-cb12-41cf-824d-ab0f35bf81d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 200 len: 1303 microversion: 2.1 time: 0.099635 Sep 23 03:16:48.535266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 329/656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:48 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:48.777433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c73940e1-b9bd-4842-90be-0ade39c13585"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:48.778692 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:48.785284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.785718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.786468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.786888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.992102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:48.992747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:48.998724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:48.999172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:48.999934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:49.000368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:49.176298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:49.183742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b20fb8af-2039-4476-ba94-267d5d0fc961 tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1522 microversion: 2.1 time: 0.195151 Sep 23 03:16:49.184581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 330/657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:48 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:49.250906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:49.252372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:49.258053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:49.258489 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:49.259235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:49.259659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:49.370733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-50b48cd7-c3de-4a46-a155-c75c5e360390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 38275 microversion: 2.20 time: 0.123319 Sep 23 03:16:49.371381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 331/658] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:49 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 38275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:49.552391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:49.553023 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: 45b71f99-c432-4dbb-a61c-8b42dc97b750] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:49.559469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:49.559864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:49.560674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:49.561104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:49.572369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-39ce95b8-3a43-4d73-880b-3ae38ab80be7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "POST /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798937 Sep 23 03:16:49.577925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 328/659] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:16:48 2021] POST /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:49.580085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] HTTP exception thrown: Instance 45b71f99-c432-4dbb-a61c-8b42dc97b750 could not be found. Sep 23 03:16:49.580749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Returning 404 to user: Instance 45b71f99-c432-4dbb-a61c-8b42dc97b750 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:16:49.581582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0a2bff54-6274-48f3-b584-a413d4101974 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750" status: 404 len: 111 microversion: 2.1 time: 0.034325 Sep 23 03:16:49.582127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 332/660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:49 2021] GET /compute/v2.1/servers/45b71f99-c432-4dbb-a61c-8b42dc97b750 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:16:49.688249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-911289404", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "0b85a16e-dcb5-4356-9889-fba810265f88"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:49.751345 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] validate_networks() for [('0b85a16e-dcb5-4356-9889-fba810265f88', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:16:50.019841 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-ceb809ec-b31d-4c06-ac6f-84e5c4b340ad req-0425a211-2b61-42d0-a73e-607ab1974d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ba4276-abfb-4947-920f-a0cc8dffab54", "name": "network-vif-deleted", "tag": "a49c2a6f-b48c-430a-a827-5f061c7c60c2"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:50.022185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:50.022185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:16:50.029961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ceb809ec-b31d-4c06-ac6f-84e5c4b340ad req-0425a211-2b61-42d0-a73e-607ab1974d83 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.030550 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ceb809ec-b31d-4c06-ac6f-84e5c4b340ad req-0425a211-2b61-42d0-a73e-607ab1974d83 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.041843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-ceb809ec-b31d-4c06-ac6f-84e5c4b340ad req-0425a211-2b61-42d0-a73e-607ab1974d83 service nova] Creating event network-vif-deleted:a49c2a6f-b48c-430a-a827-5f061c7c60c2 for instance 97ba4276-abfb-4947-920f-a0cc8dffab54 on hv-cinder-76845 Sep 23 03:16:50.046905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-ceb809ec-b31d-4c06-ac6f-84e5c4b340ad req-0425a211-2b61-42d0-a73e-607ab1974d83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030620 Sep 23 03:16:50.047569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 333/661] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:50.104636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:16:50.105151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:16:50.105537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:16:50.105937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:16:50.106347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:16:50.115388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.120846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.120846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.120846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.133716 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Getting quotas for project 5939c75066cc45d8bfb227964729f041. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:16:50.137642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Getting quotas for user f14f97daab1d499b8027de90847e6757 and project 5939c75066cc45d8bfb227964729f041. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:16:50.148836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:16:50.151255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:16:50.200425 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:50.201214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:50.207927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.208359 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.209136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.209560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.238878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.239252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.239724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lazy-loading 'fault' on Instance uuid 97ba4276-abfb-4947-920f-a0cc8dffab54 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:50.279850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd9a5404ac747d4964d215c96918625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d49e25ce7449f8ae6c33149e67246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:50.288701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6abd9b51-c143-43e9-8460-67b1538f8b8d tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 200 len: 1312 microversion: 2.1 time: 0.091447 Sep 23 03:16:50.291321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 334/662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:50 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:50.291440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc9cdcb7-59c0-4d0d-9034-99a942ea9206 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606311 Sep 23 03:16:50.291572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 329/663] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:16:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:16:50.301638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d06dd18d-c274-4c31-9566-6cd617e4346f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:50.302270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d06dd18d-c274-4c31-9566-6cd617e4346f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:50.351984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d06dd18d-c274-4c31-9566-6cd617e4346f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:50.358717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d06dd18d-c274-4c31-9566-6cd617e4346f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1213 microversion: 2.1 time: 0.061213 Sep 23 03:16:50.359601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 335/664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:50 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1213 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:50.383337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:50.384301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:50.391059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.391498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.392319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:50.392774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:50.491300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f7ebb940-e030-4acb-9dd5-77a9928aaa47 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 38275 microversion: 2.20 time: 0.111441 Sep 23 03:16:50.491946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 330/665] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:50 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 38275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:16:51.305487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:51.306092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] [instance: 97ba4276-abfb-4947-920f-a0cc8dffab54] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:51.312262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.312734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.313559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.313992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.327590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] HTTP exception thrown: Instance 97ba4276-abfb-4947-920f-a0cc8dffab54 could not be found. Sep 23 03:16:51.328174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] Returning 404 to user: Instance 97ba4276-abfb-4947-920f-a0cc8dffab54 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:16:51.329026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-49fc319a-8dc9-47d0-ada1-c4bff1fe43be tempest-ServerRescueNegativeTestJSON-1403964817 tempest-ServerRescueNegativeTestJSON-1403964817-project] 10.222.0.23 "GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54" status: 404 len: 111 microversion: 2.1 time: 0.027355 Sep 23 03:16:51.329556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 336/666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:51 2021] GET /compute/v2.1/servers/97ba4276-abfb-4947-920f-a0cc8dffab54 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:16:51.375666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:51.376278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:51.383522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.384006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.384773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.385203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.447596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:51.454847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cb0bfb37-0f04-41f3-83c2-3b308f477ac5 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1217 microversion: 2.1 time: 0.083288 Sep 23 03:16:51.455404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 331/667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:51 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:51.503641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:51.506445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:51.512629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.513303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.514089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.514576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.618043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-86269dc0-92ae-46d8-bba0-8699c18009ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 200 len: 38416 microversion: 2.20 time: 0.118589 Sep 23 03:16:51.623465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 337/668] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:51 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 38416 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:51.629571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:51.629955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:51.635970 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.636408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.637199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:51.637632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:51.662507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d39a23ed-0c1d-45cb-9ce3-ff8ddc9359ac tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/ips" status: 200 len: 151 microversion: 2.20 time: 0.037639 Sep 23 03:16:51.663320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 332/669] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Sep 23 03:16:51 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:16:52.472092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:52.472782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:52.479583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:52.480030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:52.480908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:52.481304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:52.586076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:52.593650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5bced71f-2517-493d-9fad-324827b69295 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1265 microversion: 2.1 time: 0.126330 Sep 23 03:16:52.600140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 338/670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:52 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:53.611880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:53.613437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:53.620034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:53.620776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:53.621900 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:53.622515 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:53.699181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:53.707277 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5a400da7-b132-4687-a6d8-bce9ec07b2bf tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1271 microversion: 2.1 time: 0.099957 Sep 23 03:16:53.707845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 333/671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:53 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:54.723352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:54.723948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:54.731155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:54.731707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:54.732789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:54.733213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:54.890824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:54.903562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b540bd1c-5ea3-4761-924a-990c689053d6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.184134 Sep 23 03:16:54.904391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 339/672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:54 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:54.919814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-e645da16-8f74-4994-b62c-2eccd6e6ac40 req-ce529ac7-e418-42ce-8c50-814d0eccbb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47c32ac-d333-4a09-a0bf-51388e2ce612", "tag": "b23fb734-5215-47cd-b995-dbbbe029732c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:54.921537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:16:54.921537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:16:54.936778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-e645da16-8f74-4994-b62c-2eccd6e6ac40 req-ce529ac7-e418-42ce-8c50-814d0eccbb79 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:54.937273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-e645da16-8f74-4994-b62c-2eccd6e6ac40 req-ce529ac7-e418-42ce-8c50-814d0eccbb79 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:54.982971 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-e645da16-8f74-4994-b62c-2eccd6e6ac40 req-ce529ac7-e418-42ce-8c50-814d0eccbb79 service nova] Creating event network-changed:b23fb734-5215-47cd-b995-dbbbe029732c for instance c47c32ac-d333-4a09-a0bf-51388e2ce612 on hv-cinder-76845 Sep 23 03:16:54.998536 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-e645da16-8f74-4994-b62c-2eccd6e6ac40 req-ce529ac7-e418-42ce-8c50-814d0eccbb79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082432 Sep 23 03:16:54.999343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 334/673] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:55.874969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:55.875548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:55.882024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:55.882467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:55.883221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:55.883648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:55.905766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lazy-loading 'flavor' on Instance uuid 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:55.921609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:55.922339 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:55.928891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:55.929404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:55.930261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:55.930765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:56.058785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:56.066733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b88e155c-59e7-4ecb-bdfc-3384fc6e06a6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.149572 Sep 23 03:16:56.067354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 335/674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:55 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:16:56.460436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-04dbae7d-0cd7-41db-932d-6787e237ffcd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 202 len: 0 microversion: 2.20 time: 0.589447 Sep 23 03:16:56.464549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 340/675] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:16:55 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:16:56.469512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:56.470126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:56.476385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:56.476890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:56.477659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:56.478089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:56.606554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:56.621474 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:56.623058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:56.624205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2e670fc6-15f5-473d-8a44-970b14729f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.158451 Sep 23 03:16:56.628866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 336/676] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:16:56 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:16:57.085273 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:57.086291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:57.092815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:57.093692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:57.094001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:57.094430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:57.225800 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:57.231542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-204da990-94b5-4605-88e4-e154b023e0d9 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.151610 Sep 23 03:16:57.232355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 341/677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:57 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:57.540473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f7e07a66-1be6-43d1-9cb9-c12be71f0c9d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Action: 'create', calling method: .version_select at 0x7fd1b4242f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1222783659", "metadata": {"Type": "work"}}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:16:57.642414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:57.643019 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:57.648824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:57.649487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:57.650420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:57.650851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:57.778061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:57.786807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:57.788291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:57.789684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-25734536-deb8-4b52-889f-d5cca2935079 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.151026 Sep 23 03:16:57.792669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 342/678] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:16:57 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:16:58.235202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f7e07a66-1be6-43d1-9cb9-c12be71f0c9d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.831854 Sep 23 03:16:58.235906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 337/679] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 03:16:57 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 833 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 23 03:16:58.248580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:58.249329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:58.250353 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e34953bb-f7db-46b4-ba03-1a0ce4c6e079 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4331280>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:58.255486 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.255987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.256857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.257426 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.305289 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e34953bb-f7db-46b4-ba03-1a0ce4c6e079 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.058437 Sep 23 03:16:58.306440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 338/680] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:16:58 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:16:58.361313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:58.362017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:58.368865 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.369302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.370055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.370471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.393033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:58.400358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b2b0901c-7076-4646-9ee5-0df7470a4c24 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.155890 Sep 23 03:16:58.400942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 343/681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:58 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:58.457390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'services' on Instance uuid ee980ba2-a3de-4ed0-b4bf-f60fa358522b {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:16:58.704339 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-aa2f3f4e-991b-4d5f-9eea-137d85c671d0 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments/c73940e1-b9bd-4842-90be-0ade39c13585" status: 202 len: 0 microversion: 2.1 time: 0.347082 Sep 23 03:16:58.705574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 339/682] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:16:58 2021] DELETE /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments/c73940e1-b9bd-4842-90be-0ade39c13585 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:16:58.714383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:58.715587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:58.722501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.725014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.725014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.725014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.754055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5277f19c-86e5-46d6-8f34-3ebd2e3fa69c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Sep 23 03:16:58.754666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 344/683] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:58 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:58.811291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:58.811914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:58.818987 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.819519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.820328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:58.820748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:58.938263 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:58.946382 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:58.947912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:58.949104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0d19c1d4-62e4-42b1-b317-e604de931653 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.142531 Sep 23 03:16:58.949659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 340/684] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:16:58 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:16:59.318128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e7076560-33f6-4daa-b545-580255254e74 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b429ee50>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:59.367698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e7076560-33f6-4daa-b545-580255254e74 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.053660 Sep 23 03:16:59.368258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 345/685] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:16:59 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:59.416742 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:59.417352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:59.423196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.423642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:59.424399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.424855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:59.543983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:16:59.551724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6fb75a4f-0e87-4b02-af96-766fe20ed9f6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.138586 Sep 23 03:16:59.552291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 341/686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:16:59 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:16:59.765926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:59.766810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:59.772768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.773213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:59.773975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.774404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:59.804384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-afa8d707-7664-434a-98fd-74ede347c7f4 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Sep 23 03:16:59.804965 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 346/687] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:16:59 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:16:59.966715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:16:59.967316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:16:59.974045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.974482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:16:59.975231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:16:59.975656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:00.091745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:00.100021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:00.101528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:00.102651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cf1209ca-1081-42e6-8019-bbf3c9e81915 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.139692 Sep 23 03:17:00.103200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 342/688] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:16:59 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:00.380762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b56f3afc-9a6a-4468-b75f-978ca02ce3cc tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b41833a0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:00.429923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b56f3afc-9a6a-4468-b75f-978ca02ce3cc tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.053319 Sep 23 03:17:00.430502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 347/689] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:00 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:00.566826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:00.567420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:00.573235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:00.573672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:00.574413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:00.574836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:00.691898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:00.699053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d73b6583-5235-4088-b3ff-eb368c0b4099 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.135949 Sep 23 03:17:00.699603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 343/690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:00 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:00.817189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:00.818094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:00.823923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:00.824363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:00.825155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:00.825580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:00.854271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bdeed6f5-9695-4a42-a2fb-ebf356d3ee03 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Sep 23 03:17:00.854814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 348/691] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:17:00 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:01.120973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:01.121565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:01.128100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.128730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.129542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.129968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.251052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:01.259250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:01.261071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:01.262255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e982bed0-55c8-41dd-bcd0-51b33431b243 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.144910 Sep 23 03:17:01.262824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 344/692] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:01 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:01.442639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-873ddd51-6185-4fb2-95d4-dd6d5d5cfb3a tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4183e50>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:01.492217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-873ddd51-6185-4fb2-95d4-dd6d5d5cfb3a tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.053699 Sep 23 03:17:01.492814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 349/693] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:01 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:01.716003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:01.716527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:01.722909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.723354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.724109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.724584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.865949 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:01.866984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:01.873388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.873825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.874675 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:01.875030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:01.898669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:01.904685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-02c2ba8e-1a76-403d-8b73-adf60b040879 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Sep 23 03:17:01.905239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 350/694] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:17:01 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:01.905855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-304b547c-40a3-4dc4-9ba9-01fb66dcfa87 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.193689 Sep 23 03:17:01.906567 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 345/695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:01 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:02.279228 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:02.279828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:02.285972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.286404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.287150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.287570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.405731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:02.413820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:02.415295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:02.416417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1e406031-7c90-4df6-8d4e-231a49df7181 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.140796 Sep 23 03:17:02.416988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 351/696] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:02 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:02.504427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9fc24fe4-a212-40a1-b418-17b3e9ea5204 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4221310>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:02.553870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9fc24fe4-a212-40a1-b418-17b3e9ea5204 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.053107 Sep 23 03:17:02.554477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 346/697] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:02 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:02.916439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:02.917365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:02.922521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:02.923127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:02.923254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.924293 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.925076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.925497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.929381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.929824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.930578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:02.931006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:02.954016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-229375ce-abcb-4b78-a7ac-e9656f8d5c51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Sep 23 03:17:02.954572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 352/698] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:17:02 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:03.047776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:03.055482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-310af4e5-b20c-45f4-b0a3-dadc55cef3d8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.136516 Sep 23 03:17:03.056039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 347/699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:02 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:03.433598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:03.434232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:03.440510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:03.440953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:03.441778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:03.442144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:03.561846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:03.567675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-24cd2c26-eb5d-472d-adc3-d957e5164f4d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4221280>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:03.570840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:03.572335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:03.573529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e07b87c4-f4c6-4c88-8893-aedd7999fcb3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.143596 Sep 23 03:17:03.574087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 353/700] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:03 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:03.620943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-24cd2c26-eb5d-472d-adc3-d957e5164f4d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.058523 Sep 23 03:17:03.621596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 348/701] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:03 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:03.965276 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:03.966199 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:03.972290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:03.972752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:03.973502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:03.973926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:04.002535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a8344f16-ccb9-41c1-8e0c-7ac54071578d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Sep 23 03:17:04.003066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 354/702] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:17:03 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:04.071459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:04.071991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:04.077964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:04.078404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:04.079181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:04.079632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:04.201557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:04.209067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b62784e1-12c8-45d5-a0e3-2ee5664be9e6 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.141415 Sep 23 03:17:04.209606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 349/703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:04 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:04.591992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:04.592718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:04.599996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:04.600476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:04.601150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:04.601587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:04.633469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-48fb6290-0552-443f-9af0-29e5bc04d723 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b42fa1f0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:04.695531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-48fb6290-0552-443f-9af0-29e5bc04d723 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 354 microversion: 2.1 time: 0.065718 Sep 23 03:17:04.696342 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 350/704] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:04 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:04.707171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-eafdc3f3-d1c0-49d2-b299-2917990cfd5a tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4221e50>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:04.736069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:04.744669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:04.746193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:04.747352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-06133ea9-f3ed-4963-8b5a-b5ce2b86797a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.159175 Sep 23 03:17:04.747895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 355/705] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:04 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:04.764557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-eafdc3f3-d1c0-49d2-b299-2917990cfd5a tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 354 microversion: 2.1 time: 0.061175 Sep 23 03:17:04.765126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 351/706] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:04 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:04.776662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-635821b5-0421-4509-b878-6fe7c2e6e757 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b41bd670>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:04.980184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-635821b5-0421-4509-b878-6fe7c2e6e757 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 202 len: 0 microversion: 2.1 time: 0.207049 Sep 23 03:17:04.984842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 356/707] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:17:04 2021] DELETE /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:17:04.989516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1b6949b5-6f93-4bbf-a2e1-380bf2eaf779 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4221670>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:05.013892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:05.020450 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:05.022208 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.023087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.024131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.024802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.057287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1b6949b5-6f93-4bbf-a2e1-380bf2eaf779 tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 200 len: 353 microversion: 2.1 time: 0.071308 Sep 23 03:17:05.057866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 352/708] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:04 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:05.066385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8379610f-8569-4fbd-b35f-e8642cb6c7fb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056374 Sep 23 03:17:05.067343 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 357/709] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:17:05 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:17:05.225621 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:05.226223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:05.232315 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.232807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.233818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.234301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.361648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:05.368937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b697a20d-fdff-42bc-ad3f-379a4c09e105 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.146900 Sep 23 03:17:05.369496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 353/710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:05 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:05.765362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:05.765869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:05.771521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.783481 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.783481 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:05.783481 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:05.893992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:05.902115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:05.903605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:05.904806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f9124342-308d-4a9a-adc9-a3f5f9ccd033 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.143169 Sep 23 03:17:05.905356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 358/711] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:05 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:06.069390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ad0aaf46-986f-4190-a939-bd2cca0bda7d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Calling method '.version_select at 0x7fd1b4331d30>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:06.094847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-ad0aaf46-986f-4190-a939-bd2cca0bda7d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] HTTP exception thrown: Volume fb1edf03-8f23-4870-8a8d-581849b3b563 could not be found. Sep 23 03:17:06.095940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ad0aaf46-986f-4190-a939-bd2cca0bda7d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] Returning 404 to user: Volume fb1edf03-8f23-4870-8a8d-581849b3b563 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:06.096766 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ad0aaf46-986f-4190-a939-bd2cca0bda7d tempest-VolumesGetTestJSON-1415549041 tempest-VolumesGetTestJSON-1415549041-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563" status: 404 len: 109 microversion: 2.1 time: 0.031035 Sep 23 03:17:06.097326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 354/712] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:06 2021] GET /compute/v2.1/os-volumes/fb1edf03-8f23-4870-8a8d-581849b3b563 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:06.385214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:06.385748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:06.391656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:06.392143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:06.392935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:06.393379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:06.528192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:06.535586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-978d2ef4-1dca-4d29-9eec-fc312c65e755 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.154079 Sep 23 03:17:06.536144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 359/713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:06 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:06.922795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:06.923311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:06.929709 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:06.930152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:06.930899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:06.931324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.073928 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:07.081758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:07.083267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:07.084399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-518ca384-818c-419a-bed3-b49d967b2dba tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.165509 Sep 23 03:17:07.084985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 355/714] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:06 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:07.535318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:07.535814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:07.545483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.545936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.547898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.547898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.552750 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:07.553615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:07.559444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.559881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.560821 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.561159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.573085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:17:07.698471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:07.706220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9cacdc83-faca-4da2-aa10-7f1def763823 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.157102 Sep 23 03:17:07.706780 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 356/715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:07 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:07.962701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5e94762f-d374-44d3-a86f-f3375b63fa00 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 204 len: 0 microversion: 2.1 time: 0.430645 Sep 23 03:17:07.963297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 360/716] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:17:07 2021] DELETE /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:17:07.972955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:07.975773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:07.980465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.980947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:07.981814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:07.982509 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.103105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:08.103856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:08.104318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:08.110046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:08.110539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.111911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:08.112070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4c5840de-bc1a-49cf-a07d-e36e5c92194d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1511 microversion: 2.1 time: 0.144725 Sep 23 03:17:08.112469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.113361 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 357/717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:07 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:08.237130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:08.250038 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:08.253101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:08.254358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c63c9d0e-07f7-4521-978c-d63430e730f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.155502 Sep 23 03:17:08.265054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 361/718] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:08 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:08.367781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-b4704ce2-2ca3-45b6-af4a-4cc8911fc97e req-c35fb46a-600c-43b3-ba91-9a802eef2167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47c32ac-d333-4a09-a0bf-51388e2ce612", "name": "network-vif-plugged", "status": "completed", "tag": "b23fb734-5215-47cd-b995-dbbbe029732c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:08.370319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:08.370319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:17:08.378790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b4704ce2-2ca3-45b6-af4a-4cc8911fc97e req-c35fb46a-600c-43b3-ba91-9a802eef2167 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:08.379338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b4704ce2-2ca3-45b6-af4a-4cc8911fc97e req-c35fb46a-600c-43b3-ba91-9a802eef2167 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.390426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-b4704ce2-2ca3-45b6-af4a-4cc8911fc97e req-c35fb46a-600c-43b3-ba91-9a802eef2167 service nova] Creating event network-vif-plugged:b23fb734-5215-47cd-b995-dbbbe029732c for instance c47c32ac-d333-4a09-a0bf-51388e2ce612 on hv-cinder-76845 Sep 23 03:17:08.395677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-b4704ce2-2ca3-45b6-af4a-4cc8911fc97e req-c35fb46a-600c-43b3-ba91-9a802eef2167 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031885 Sep 23 03:17:08.396479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 358/719] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:08.722060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:08.723254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:08.730388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:08.742388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.742388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:08.742388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:08.898071 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:08.905468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-45876bba-37e2-4181-aec5-570e67d10b0f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.187275 Sep 23 03:17:08.906038 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 362/720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:08 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:09.130795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:09.131559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:09.137431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.137870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:09.138618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.142689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:09.262076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:09.270130 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4668a633-95a0-4f11-8f00-35bb11e653cb tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1511 microversion: 2.1 time: 0.144438 Sep 23 03:17:09.270856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 359/721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:09 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:09.272614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:09.273218 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:09.278931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.279374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:09.280151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.282547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:09.398223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:09.405935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:09.407417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:09.408585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7f4c9172-c117-4988-adb5-b55080033b2e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.139757 Sep 23 03:17:09.409144 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 363/722] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:09 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:09.921545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:09.922168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:09.927988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.928422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:09.929194 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:09.929618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:10.050355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:10.058060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-22d0f40e-f8ab-4eb8-827a-471f9c498d0a tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.140178 Sep 23 03:17:10.058615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 360/723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:09 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:10.286073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:10.286796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:10.292996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:10.293437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:10.294192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:10.294620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:10.416002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:10.424957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7ab4cf92-f8bf-403f-bdf0-e22240f24cc3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1511 microversion: 2.1 time: 0.142463 Sep 23 03:17:10.431026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 364/724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:10 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:10.431165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:10.431165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:10.433596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:10.434040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:10.434822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:10.435251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:10.554815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:10.562378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:10.564421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:10.565582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ba42e5f9-7d65-41e0-b3d3-445d971ed201 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.143600 Sep 23 03:17:10.566161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 361/725] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:11.073593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:11.074200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:11.079930 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.080370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.081159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.081593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.271481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a51c5f1a-29d7-4e3b-9401-3b1313acaa9d tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b4221a60>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:11.323013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:11.325595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a51c5f1a-29d7-4e3b-9401-3b1313acaa9d tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9e0ecefb-2834-489e-afaf-9d2a2d9b2eb9" status: 200 len: 349 microversion: 2.1 time: 0.057832 Sep 23 03:17:11.326226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 362/726] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:11 2021] GET /compute/v2.1/os-volumes/9e0ecefb-2834-489e-afaf-9d2a2d9b2eb9 => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:11.332153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6f200de2-e78d-4905-860c-a297ca5e034f tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1313 microversion: 2.1 time: 0.262256 Sep 23 03:17:11.332979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 365/727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:11 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:11.443100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:11.443706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:11.449892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.450408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.451240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.451786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.582221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:11.583342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:11.583977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:11.590042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.590500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.590631 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-db3ec5fe-c5c9-4408-928b-b8f4f11e7df6 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1511 microversion: 2.1 time: 0.153174 Sep 23 03:17:11.591147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 363/728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:11 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:11.591752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.592246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.718530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:11.726393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:11.727867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:11.729070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-237c7815-b510-43f3-9632-57e4d9336b86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.149765 Sep 23 03:17:11.729624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 366/729] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:11 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:11.799506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-efc4c26d-e922-4826-98fa-e1ee8ac9cc27 req-948cae04-7cac-4154-9b7b-ed3ad54c5320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee980ba2-a3de-4ed0-b4bf-f60fa358522b", "name": "network-vif-deleted", "tag": "9f6ade92-6477-4a52-8c99-d80aa360d9ac"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:11.801100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:11.801100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:17:11.807790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-efc4c26d-e922-4826-98fa-e1ee8ac9cc27 req-948cae04-7cac-4154-9b7b-ed3ad54c5320 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:11.811355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-efc4c26d-e922-4826-98fa-e1ee8ac9cc27 req-948cae04-7cac-4154-9b7b-ed3ad54c5320 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:11.820341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-efc4c26d-e922-4826-98fa-e1ee8ac9cc27 req-948cae04-7cac-4154-9b7b-ed3ad54c5320 service nova] Creating event network-vif-deleted:9f6ade92-6477-4a52-8c99-d80aa360d9ac for instance ee980ba2-a3de-4ed0-b4bf-f60fa358522b on hv-cinder-76845 Sep 23 03:17:11.827544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-efc4c26d-e922-4826-98fa-e1ee8ac9cc27 req-948cae04-7cac-4154-9b7b-ed3ad54c5320 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032081 Sep 23 03:17:11.831034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 364/730] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:12.351783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:12.352717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:12.358751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.359188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.359965 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.360392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.475592 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:12.483106 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e2164efd-bcd9-4e8f-83c3-8617990fae98 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1498 microversion: 2.1 time: 0.135192 Sep 23 03:17:12.483661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 367/731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:12 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1498 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:12.607818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:12.608659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:12.614931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.615378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.616139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.616604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.647481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.647979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.648419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'fault' on Instance uuid ee980ba2-a3de-4ed0-b4bf-f60fa358522b {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:17:12.692586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:12.699917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b0a34ba0-afe3-4907-8a84-b99c5a19d6df tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 200 len: 1307 microversion: 2.1 time: 0.096521 Sep 23 03:17:12.701011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 365/732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:12 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:12.747247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:12.747774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:12.754278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.754717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.755483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:12.755908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:12.881534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:12.889763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:12.891309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:12.896139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6faacef9-4429-4c3f-8324-271e05a5e6ea tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.149262 Sep 23 03:17:12.896139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 368/733] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:12 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:13.628718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:13.629299 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:13.635369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.635810 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.636622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.637054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.663876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:17:13.716645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:13.717251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: ee980ba2-a3de-4ed0-b4bf-f60fa358522b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:13.723002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.723435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.724181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.724648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.738156 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Instance ee980ba2-a3de-4ed0-b4bf-f60fa358522b could not be found. Sep 23 03:17:13.738753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 404 to user: Instance ee980ba2-a3de-4ed0-b4bf-f60fa358522b could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:13.739507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2fe86f78-13f7-4dc0-9575-4b7e4b532b17 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b" status: 404 len: 111 microversion: 2.1 time: 0.026636 Sep 23 03:17:13.740018 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 369/734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:13 2021] GET /compute/v2.1/servers/ee980ba2-a3de-4ed0-b4bf-f60fa358522b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:17:13.910225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:13.910751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:13.916677 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.917119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.917992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.918423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.945727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-66a4cb29-0f63-4478-a35a-b0b2d4f909a8 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 204 len: 0 microversion: 2.1 time: 0.320837 Sep 23 03:17:13.947617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 366/735] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:17:13 2021] DELETE /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:17:13.965184 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:13.965184 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:13.970189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.970628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:13.971393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:13.971816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:14.055898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:14.065431 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:14.066442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:14.067771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-11457d7e-6253-4476-9b3b-1ee6bcfdad7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.161428 Sep 23 03:17:14.076545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 370/736] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:13 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:14.111393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:14.116799 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c1d51312-ffa6-40ad-84e3-3c2fa9e92151 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b431bc10>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:14.118973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-50e3f886-6bef-4b93-ab5a-5404822d8560 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1504 microversion: 2.1 time: 0.159677 Sep 23 03:17:14.119534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 367/737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:13 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:14.167224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c1d51312-ffa6-40ad-84e3-3c2fa9e92151 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0756b30a-f977-4c83-8b25-9e1c16a2f7d0" status: 200 len: 351 microversion: 2.1 time: 0.054068 Sep 23 03:17:14.167817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 371/738] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:14 2021] GET /compute/v2.1/os-volumes/0756b30a-f977-4c83-8b25-9e1c16a2f7d0 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:15.031232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:15.031729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:15.046227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.046227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.046227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.046227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.069600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:17:15.086698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:15.087268 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:15.093117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.093556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.094313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.094758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.215938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:15.223788 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:15.225301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:15.226433 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9086be98-156b-4526-a7cd-8ac7c430a82f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.143543 Sep 23 03:17:15.226979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 372/739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:15 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:15.231113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:15.231701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:15.238037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.241053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.241053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.241053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.363823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:15.370991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-73676160-4371-4792-b9c3-cd6aa832e226 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1504 microversion: 2.1 time: 0.143083 Sep 23 03:17:15.371798 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 373/740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:15 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:15.373799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d6f34687-3979-44c3-8708-2f09fe776167 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 204 len: 0 microversion: 2.1 time: 0.345912 Sep 23 03:17:15.374476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 368/741] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:17:15 2021] DELETE /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:17:15.383585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:15.384191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:15.390099 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.390545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.391299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:15.391725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:15.512400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:15.519686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c94f27e8-4876-47a0-a6de-68ba39b11b53 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1512 microversion: 2.1 time: 0.139717 Sep 23 03:17:15.520255 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 374/742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:15 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1512 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:16.245571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:16.246287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:16.252148 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.252618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.253376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.253830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.377212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:16.384841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:16.386329 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:16.387466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7685e1e0-4059-4f47-bf08-6ea50d39663d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.145952 Sep 23 03:17:16.388018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 369/743] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:16 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:16.388143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:16.388838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:16.394653 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.395085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.396846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.396846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.537247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:16.537893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:16.543832 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.544274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.545068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:16.545497 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:16.547891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:16.557585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-684c0532-27bb-416f-a418-a10c75e80004 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1504 microversion: 2.1 time: 0.172132 Sep 23 03:17:16.557585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 375/744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:16 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:16.678947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:16.686396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f9bf9372-a9eb-4752-b4ff-aac61ef57730 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1512 microversion: 2.1 time: 0.153336 Sep 23 03:17:16.687507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 370/745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:16 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:17.008950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c5a1cb3c-60a1-4959-bc25-85eb24b34b6b tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b41bd310>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.068285 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c5a1cb3c-60a1-4959-bc25-85eb24b34b6b tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b53accfe-fdb0-4834-ab2a-3d9eac4bd071" status: 200 len: 351 microversion: 2.1 time: 0.062716 Sep 23 03:17:17.075677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-d2b758f2-6034-40b4-aa19-5f8afc467b6d req-f74f3bfe-d2e5-401f-893c-f96257998d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47c32ac-d333-4a09-a0bf-51388e2ce612", "name": "network-vif-deleted", "tag": "b23fb734-5215-47cd-b995-dbbbe029732c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:17.075677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:17.075677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:17:17.076340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 376/746] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes/b53accfe-fdb0-4834-ab2a-3d9eac4bd071 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:17.081246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d2b758f2-6034-40b4-aa19-5f8afc467b6d req-f74f3bfe-d2e5-401f-893c-f96257998d36 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.085147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0f48b902-7fd0-4131-9ac6-47e9273a0351 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b4112ca0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.085284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d2b758f2-6034-40b4-aa19-5f8afc467b6d req-f74f3bfe-d2e5-401f-893c-f96257998d36 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.093581 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-d2b758f2-6034-40b4-aa19-5f8afc467b6d req-f74f3bfe-d2e5-401f-893c-f96257998d36 service nova] Creating event network-vif-deleted:b23fb734-5215-47cd-b995-dbbbe029732c for instance c47c32ac-d333-4a09-a0bf-51388e2ce612 on hv-cinder-76845 Sep 23 03:17:17.098457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-d2b758f2-6034-40b4-aa19-5f8afc467b6d req-f74f3bfe-d2e5-401f-893c-f96257998d36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032617 Sep 23 03:17:17.099338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 371/747] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:17.164535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0f48b902-7fd0-4131-9ac6-47e9273a0351 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087021 Sep 23 03:17:17.165140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 377/748] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:17.177655 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c3cbda90-c371-4c55-a9fa-4c899967676c tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b42215e0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.266234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c3cbda90-c371-4c55-a9fa-4c899967676c tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092546 Sep 23 03:17:17.273870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 372/749] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:17.278857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5cbc6083-3b01-4bcb-9d1a-4c3d6ddfe935 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b4181ca0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.359900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5cbc6083-3b01-4bcb-9d1a-4c3d6ddfe935 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084548 Sep 23 03:17:17.367047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 378/750] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:17.371689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8f68b619-1b9e-4882-8271-a6a27b97c5e2 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b42c7b80>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.405592 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.406275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:17.412361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.412840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.413599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.414029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.457436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8f68b619-1b9e-4882-8271-a6a27b97c5e2 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089348 Sep 23 03:17:17.458017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 373/751] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:17.469157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-02f806af-3bd2-440c-98e5-a0cb67c1cd83 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b41bf790>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.542456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:17.551602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:17.553897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-02f806af-3bd2-440c-98e5-a0cb67c1cd83 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088332 Sep 23 03:17:17.554508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 374/752] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:17.557854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:17.557854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d9bf0207-7376-41ab-bbe3-17efd8345396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.155241 Sep 23 03:17:17.557854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 379/753] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:17:17.566545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-48517695-9872-466b-adbd-31acea2af573 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b41bfdc0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.575118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.575750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:17.581871 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.582345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.583132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.583571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.615218 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.615706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.616275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lazy-loading 'fault' on Instance uuid c47c32ac-d333-4a09-a0bf-51388e2ce612 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:17:17.646127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-48517695-9872-466b-adbd-31acea2af573 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083514 Sep 23 03:17:17.646788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 375/754] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:17.657163 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-40180e32-7033-4515-8d51-6452d703acd2 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b4395c10>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.662266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f97daab1d499b8027de90847e6757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5939c75066cc45d8bfb227964729f041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:17.671769 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8fe3b6f7-ad75-46ec-b232-4e86fe136b34 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 200 len: 1303 microversion: 2.1 time: 0.101410 Sep 23 03:17:17.672341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 380/755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:17.703782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.704689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:17.710827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.711265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.712086 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:17.712612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:17.751961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-40180e32-7033-4515-8d51-6452d703acd2 tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097523 Sep 23 03:17:17.756582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 376/756] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:17.763994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-86d1f7da-694a-45c0-acc1-87fda0d2f97f tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] Calling method '.version_select at 0x7fd1b4221310>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:17.849590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:17.855072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-86d1f7da-694a-45c0-acc1-87fda0d2f97f tempest-VolumesTestJSON-1860354931 tempest-VolumesTestJSON-1860354931-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094758 Sep 23 03:17:17.855798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 377/757] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:17.857790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3439e27c-9d0d-4cb0-af20-e2de54f00502 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1512 microversion: 2.1 time: 0.158350 Sep 23 03:17:17.858512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 381/758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:17 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:18.360139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-3b4cd0ac-9645-41e1-96a6-a57049529c7e req-5dea2df7-73fb-4089-a7cc-4abf82fc8907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "name": "network-vif-plugged", "status": "completed", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:18.361888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:18.361888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:17:18.369328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-3b4cd0ac-9645-41e1-96a6-a57049529c7e req-5dea2df7-73fb-4089-a7cc-4abf82fc8907 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.369855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-3b4cd0ac-9645-41e1-96a6-a57049529c7e req-5dea2df7-73fb-4089-a7cc-4abf82fc8907 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.382316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-3b4cd0ac-9645-41e1-96a6-a57049529c7e req-5dea2df7-73fb-4089-a7cc-4abf82fc8907 service nova] Creating event network-vif-plugged:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:17:18.387070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-3b4cd0ac-9645-41e1-96a6-a57049529c7e req-5dea2df7-73fb-4089-a7cc-4abf82fc8907 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030938 Sep 23 03:17:18.387841 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 378/759] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:18.575275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:18.575859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:18.582392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.582894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.583700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.584125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.690170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:18.690862 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] [instance: c47c32ac-d333-4a09-a0bf-51388e2ce612] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:18.697196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.700520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.701230 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.701672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.716276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] HTTP exception thrown: Instance c47c32ac-d333-4a09-a0bf-51388e2ce612 could not be found. Sep 23 03:17:18.717989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] Returning 404 to user: Instance c47c32ac-d333-4a09-a0bf-51388e2ce612 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:18.717989 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5ae5f4e9-d26f-4d6c-a8a7-da197e7dbcc7 tempest-VolumesActionsTest-680203796 tempest-VolumesActionsTest-680203796-project] 10.222.0.23 "GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612" status: 404 len: 111 microversion: 2.1 time: 0.032225 Sep 23 03:17:18.718603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 379/760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:18 2021] GET /compute/v2.1/servers/c47c32ac-d333-4a09-a0bf-51388e2ce612 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:17:18.784362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:18.791977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:18.793475 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:18.794612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-77c0b321-38de-484b-adde-1255a8550390 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.223243 Sep 23 03:17:18.795165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 382/761] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:18 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:18.875374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:18.876247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:18.883783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.884302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.885123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:18.885547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:18.952482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:18.963153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-02fcca35-88d2-43a0-b06d-59acb0903d51 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1470 microversion: 2.1 time: 0.090756 Sep 23 03:17:18.964610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 380/762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:18 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:17:19.114518 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-0fce832a-38bd-4e3a-980b-bde40b0c5f2a req-ba203082-0bf9-4dc5-ae76-a1371afe91f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1794ea1-9fe8-477d-9b84-69b84a923ec2", "name": "network-vif-deleted", "tag": "032fd351-ef94-4f58-8754-acd5c5fa124d"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:19.116108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:19.116108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:17:19.123161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-0fce832a-38bd-4e3a-980b-bde40b0c5f2a req-ba203082-0bf9-4dc5-ae76-a1371afe91f2 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:19.123599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-0fce832a-38bd-4e3a-980b-bde40b0c5f2a req-ba203082-0bf9-4dc5-ae76-a1371afe91f2 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:19.134651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-0fce832a-38bd-4e3a-980b-bde40b0c5f2a req-ba203082-0bf9-4dc5-ae76-a1371afe91f2 service nova] Creating event network-vif-deleted:032fd351-ef94-4f58-8754-acd5c5fa124d for instance f1794ea1-9fe8-477d-9b84-69b84a923ec2 on hv-cinder-76845 Sep 23 03:17:19.139599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-0fce832a-38bd-4e3a-980b-bde40b0c5f2a req-ba203082-0bf9-4dc5-ae76-a1371afe91f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029112 Sep 23 03:17:19.145942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 383/763] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:19.812946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:19.813577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:19.819435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:19.819870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:19.820656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:19.821081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:19.948798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:19.957252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:19.958632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:19.959808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4c95058c-e135-4a68-b1ce-89d587c84f4c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1744 microversion: 2.20 time: 0.150619 Sep 23 03:17:19.960592 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 381/764] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:19 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:19.980463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:19.981185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:19.987364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:19.987814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:19.988582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:19.989198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:20.019296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:20.019735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:20.020176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'fault' on Instance uuid f1794ea1-9fe8-477d-9b84-69b84a923ec2 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:17:20.065537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:20.072786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-96682da9-9fba-4478-b1d1-5dec294d3477 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 200 len: 1308 microversion: 2.1 time: 0.096244 Sep 23 03:17:20.073726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 384/765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:19 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:20.978389 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:20.978983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:20.985170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:20.986192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:20.986945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:20.987372 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.090552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:21.091195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: f1794ea1-9fe8-477d-9b84-69b84a923ec2] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:21.097744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.098594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.098942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.099368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.113260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:21.113566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Instance f1794ea1-9fe8-477d-9b84-69b84a923ec2 could not be found. Sep 23 03:17:21.114164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 404 to user: Instance f1794ea1-9fe8-477d-9b84-69b84a923ec2 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:21.114987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-057a1aa6-6e7a-40b0-a7fe-03afa9316dda tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2" status: 404 len: 111 microversion: 2.1 time: 0.028154 Sep 23 03:17:21.115527 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 385/766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:21 2021] GET /compute/v2.1/servers/f1794ea1-9fe8-477d-9b84-69b84a923ec2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:17:21.123003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:21.123369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:21.123498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:21.125590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:21.127159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f7d0affc-51b9-4634-bb4c-92dccb24646b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.152503 Sep 23 03:17:21.127737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 382/767] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:20 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:21.132179 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.132831 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.134232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.134662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.160101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:17:21.563316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e1712865-896d-4f12-8371-864bac2c8047 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 204 len: 0 microversion: 2.1 time: 0.443132 Sep 23 03:17:21.564977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 386/768] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:17:21 2021] DELETE /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:17:21.573824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:21.574377 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:21.581857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.582297 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.583058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:21.583480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:21.747998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:21.756691 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0ad0fb11-e4a5-4c8b-9663-baf7dd4f2b57 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.187541 Sep 23 03:17:21.758885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 383/769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:21 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:22.164601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:22.165297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:22.173423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:22.173877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:22.174662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:22.175096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:22.320765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:22.330690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:22.332474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:22.333786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-648e084b-36f3-46cc-b760-a44030feba95 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.192136 Sep 23 03:17:22.336464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 387/770] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:22 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:22.774488 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:22.775062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:22.781279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:22.781976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:22.783487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:22.784063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:22.922301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:22.930704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-65b7adc9-49a0-48ef-9721-a009b9eb0b24 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.159866 Sep 23 03:17:22.931406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 384/771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:22 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:23.352734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:23.353371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:23.361186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:23.362051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:23.363133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:23.364659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:23.524524 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:23.533165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:23.535020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:23.536238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-837ddeec-611b-485d-81dd-479fcfe2d30e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.187914 Sep 23 03:17:23.536914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 388/772] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:23 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:23.949368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:23.949990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:23.956326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:23.956803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:23.957563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:23.957994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:24.084899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:24.092294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc162d45-1af3-46d9-889c-632d3ae907a3 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.146583 Sep 23 03:17:24.092894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 385/773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:23 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:24.554957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:24.556324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:24.562509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:24.564570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:24.565790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:24.566388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:24.725072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:24.740560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:24.743014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:24.744135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6346d1af-397b-4c3a-916d-cf9e0608d4b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.193108 Sep 23 03:17:24.744716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 389/774] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:24 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:25.109777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:25.112143 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:25.118374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:25.119075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:25.119848 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:25.120275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:25.284252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:25.292681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6876275f-f783-483b-881d-9acb2f1f53e5 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.186862 Sep 23 03:17:25.302781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 386/775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:25 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:25.763801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:25.764408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:25.771317 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:25.771700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:25.772467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:25.772923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:25.915035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:25.925923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:25.927789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:25.929442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c9373a0a-c5d3-48f3-80d2-40cd01476cd4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.169373 Sep 23 03:17:25.930187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 390/776] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:25 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:26.309923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:26.311416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:26.318616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:26.319057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:26.319830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:26.320434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:26.457755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:26.467522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d8fee5e4-058f-40eb-98dd-b0f8deca7de7 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.161394 Sep 23 03:17:26.468395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 387/777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:26 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:26.977121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:26.977765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:26.984422 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:26.992854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:26.993714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:26.994158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:27.125533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:27.133226 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:27.134701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:27.135840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37120ab2-f1ad-4461-b76c-9a023b268beb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.191381 Sep 23 03:17:27.136380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 391/778] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:26 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:27.484707 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:27.485500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:27.491639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:27.492186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:27.493053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:27.493549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:27.634548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:27.642894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6649b5ea-b266-4e9b-8b90-43d6dd65eed1 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.162073 Sep 23 03:17:27.652277 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 388/779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:27 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:28.154237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:28.154852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:28.165217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:28.166207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:28.167214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:28.167860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:28.306354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:28.316002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:28.317707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:28.321339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9346c96c-00a0-4a01-ba60-da1cdcc6d85f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.169305 Sep 23 03:17:28.321833 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 392/780] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:28 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:28.660857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:28.661981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:28.669974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:28.670717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:28.671823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:28.672609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:28.842463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:28.859643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3dc6c9d7-7818-4866-86d0-8fd55e895b7e tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.203729 Sep 23 03:17:28.863244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 389/781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:28 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:29.352309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:29.354154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:29.363630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:29.364278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:29.365678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:29.366344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:29.799534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:29.806497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:29.808502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:29.809834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5b9ccc99-904f-4125-a91d-80a025701369 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.462713 Sep 23 03:17:29.811020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 393/782] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:29 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:29.880249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:29.881078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:29.892740 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:29.893189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:29.893974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:29.894406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:30.108326 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:30.118172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-69b6e4c0-5e6d-4d0c-be11-a0567faf536c tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1512 microversion: 2.1 time: 0.241432 Sep 23 03:17:30.136906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 390/783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:29 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:30.569029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-3897d201-6f3a-476d-9fcd-e3288f94881e req-0cba5b52-5943-4b76-9d8d-014faca2718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65bf9db1-21c8-4b33-b64e-ad883343ff9a", "name": "network-vif-deleted", "tag": "870ddb4f-c1ed-4a3d-9a01-248d232a6fa2"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:30.570672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:30.570672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:17:30.577531 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-3897d201-6f3a-476d-9fcd-e3288f94881e req-0cba5b52-5943-4b76-9d8d-014faca2718f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:30.578081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-3897d201-6f3a-476d-9fcd-e3288f94881e req-0cba5b52-5943-4b76-9d8d-014faca2718f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:30.589478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-3897d201-6f3a-476d-9fcd-e3288f94881e req-0cba5b52-5943-4b76-9d8d-014faca2718f service nova] Creating event network-vif-deleted:870ddb4f-c1ed-4a3d-9a01-248d232a6fa2 for instance 65bf9db1-21c8-4b33-b64e-ad883343ff9a on hv-cinder-76845 Sep 23 03:17:30.595053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-3897d201-6f3a-476d-9fcd-e3288f94881e req-0cba5b52-5943-4b76-9d8d-014faca2718f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029187 Sep 23 03:17:30.595727 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 394/784] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:17:30.828260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:30.829534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:30.835265 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:30.835700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:30.836440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:30.836892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:30.998544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:31.007262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:31.008764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:31.009929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-634eee28-da31-4fc5-99bf-a44cdacf1765 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.185377 Sep 23 03:17:31.010483 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 391/785] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:30 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:31.139439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:31.140328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:31.153646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:31.154381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:31.157570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:31.157570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:31.224060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:31.241323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:31.244218 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'fault' on Instance uuid 65bf9db1-21c8-4b33-b64e-ad883343ff9a {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:17:31.298211 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:31.307270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2905c981-27c8-4360-9b8f-3d5fe8060a1d tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 200 len: 1308 microversion: 2.1 time: 0.171969 Sep 23 03:17:31.308186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 395/786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:31 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:32.031135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:32.032675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:32.041362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:32.041816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:32.044874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:32.045316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:32.249605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:32.262196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:32.263963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:32.267352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce938118-9839-4bfc-9c30-4884577dfeb6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.240745 Sep 23 03:17:32.279742 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 392/787] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:32 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:32.323279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:32.326927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 65bf9db1-21c8-4b33-b64e-ad883343ff9a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:32.332435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:32.332906 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:32.333680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:32.334116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:32.348082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Instance 65bf9db1-21c8-4b33-b64e-ad883343ff9a could not be found. Sep 23 03:17:32.349710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 404 to user: Instance 65bf9db1-21c8-4b33-b64e-ad883343ff9a could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.349710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3492d483-59a1-481f-b595-b835ff85cb6f tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a" status: 404 len: 111 microversion: 2.1 time: 0.030434 Sep 23 03:17:32.350737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 396/788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:32 2021] GET /compute/v2.1/servers/65bf9db1-21c8-4b33-b64e-ad883343ff9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:32.707663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c454aabb-81b5-4af3-899f-1be1db18a4f3 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Action: 'create', calling method: .version_select at 0x7fd1b41bf700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1427913719", "metadata": {"Type": "work"}}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:32.709575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c454aabb-81b5-4af3-899f-1be1db18a4f3 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.710669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c454aabb-81b5-4af3-899f-1be1db18a4f3 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144661 Sep 23 03:17:32.717837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 393/789] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 03:17:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:17:32.722643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bdd107fc-4de3-459e-99ff-e2150447fa90 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Action: 'create', calling method: .version_select at 0x7fd1b4183b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1581660268", "metadata": {"Type": "work"}}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:32.724828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bdd107fc-4de3-459e-99ff-e2150447fa90 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.725738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bdd107fc-4de3-459e-99ff-e2150447fa90 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008471 Sep 23 03:17:32.726271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 397/790] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 03:17:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:17:32.735735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-684a72ac-d497-4dfa-a3a9-aa802b6f3754 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Action: 'create', calling method: .version_select at 0x7fd1b41bf1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1480014496", "metadata": {"Type": "work"}}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:32.736934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-684a72ac-d497-4dfa-a3a9-aa802b6f3754 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.737722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-684a72ac-d497-4dfa-a3a9-aa802b6f3754 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006040 Sep 23 03:17:32.738513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 394/791] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Sep 23 03:17:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 03:17:32.749287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-698b6511-4400-418e-a41e-eaa4f64e96c4 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Calling method '.version_select at 0x7fd1b415b790>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:32.790103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-698b6511-4400-418e-a41e-eaa4f64e96c4 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] HTTP exception thrown: Volume tempest-invalid-1848081078 could not be found. Sep 23 03:17:32.791105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-698b6511-4400-418e-a41e-eaa4f64e96c4 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 404 to user: Volume tempest-invalid-1848081078 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.792130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-698b6511-4400-418e-a41e-eaa4f64e96c4 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1848081078" status: 404 len: 99 microversion: 2.1 time: 0.047377 Sep 23 03:17:32.792874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 398/792] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Sep 23 03:17:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1848081078 => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 03:17:32.806220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0f061ed5-a017-4949-ab3c-5b3240512484 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005805 Sep 23 03:17:32.822291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 395/793] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Sep 23 03:17:32 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 03:17:32.835046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5e2018b3-6da5-4e0b-8b81-d1d2fefed446 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006742 Sep 23 03:17:32.835807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 399/794] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Sep 23 03:17:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 03:17:32.845268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1c9294e9-5003-44c1-b9fa-acd64bc8a774 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Calling method '.version_select at 0x7fd1b4248790>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:32.873584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-1c9294e9-5003-44c1-b9fa-acd64bc8a774 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] HTTP exception thrown: Volume 8e135060-17ad-4404-9149-d2a3abeb7d29 could not be found. Sep 23 03:17:32.874177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1c9294e9-5003-44c1-b9fa-acd64bc8a774 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 404 to user: Volume 8e135060-17ad-4404-9149-d2a3abeb7d29 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.874990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1c9294e9-5003-44c1-b9fa-acd64bc8a774 tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/8e135060-17ad-4404-9149-d2a3abeb7d29" status: 404 len: 109 microversion: 2.1 time: 0.034196 Sep 23 03:17:32.875551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 396/795] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:17:32 2021] DELETE /compute/v2.1/os-volumes/8e135060-17ad-4404-9149-d2a3abeb7d29 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:32.884774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e90205ff-6692-4848-9f12-12fc6ea9061a tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Calling method '.version_select at 0x7fd1b4183310>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:32.910362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-e90205ff-6692-4848-9f12-12fc6ea9061a tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] HTTP exception thrown: Volume 6072298f-f68e-4dfa-a9b8-39b9fa2aef0b could not be found. Sep 23 03:17:32.910942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e90205ff-6692-4848-9f12-12fc6ea9061a tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] Returning 404 to user: Volume 6072298f-f68e-4dfa-a9b8-39b9fa2aef0b could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:32.911745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e90205ff-6692-4848-9f12-12fc6ea9061a tempest-VolumesNegativeTest-1593430816 tempest-VolumesNegativeTest-1593430816-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6072298f-f68e-4dfa-a9b8-39b9fa2aef0b" status: 404 len: 109 microversion: 2.1 time: 0.030565 Sep 23 03:17:32.912369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 400/796] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Sep 23 03:17:32 2021] GET /compute/v2.1/os-volumes/6072298f-f68e-4dfa-a9b8-39b9fa2aef0b => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:17:33.286780 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:33.287402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:33.306402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:33.307634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:33.311083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:33.311083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:33.521974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:33.541566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:33.545279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:33.547378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-959a1fbd-93c7-408e-81b4-7ac0a4558a6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1739 microversion: 2.20 time: 0.263706 Sep 23 03:17:33.548330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 397/797] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:33 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:33.629662 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:33.631007 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:33.637166 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:33.637831 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:33.638606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:33.639037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:33.665752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:17:33.997127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c983c3b3-029e-4af8-ad5b-31f6ebef6c65 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 204 len: 0 microversion: 2.1 time: 0.371602 Sep 23 03:17:33.997806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 401/798] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:17:33 2021] DELETE /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:17:34.005772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:34.006617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:34.021114 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:34.021817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:34.022755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:34.023627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:34.201878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:34.209738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0fb67418-ccb7-409f-8c63-9a59f4d6bc23 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1512 microversion: 2.1 time: 0.207837 Sep 23 03:17:34.210785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 398/799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:34 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:34.577061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:34.577733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:34.588813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:34.589568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:34.590579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:34.591395 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:34.809731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:34.818136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:34.819666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:34.820905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-45f541ad-b838-4a0e-96d1-57df2f508066 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1721 microversion: 2.20 time: 0.254493 Sep 23 03:17:34.821748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 402/800] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:34 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:35.230282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:35.231459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:35.242908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:35.243507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:35.244352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:35.245188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:35.411811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:35.424724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-67afcd0d-cd1f-4020-a73c-d95bc9f69443 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1512 microversion: 2.1 time: 0.200672 Sep 23 03:17:35.426529 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 399/801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:35 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:35.709579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-d49332da-672f-4d1b-bde6-8b2426dc5108 req-75ec17fe-1123-493d-ba79-fdbb901d1505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "name": "network-vif-unplugged", "status": "completed", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:35.711158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:35.711158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:17:35.718473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d49332da-672f-4d1b-bde6-8b2426dc5108 req-75ec17fe-1123-493d-ba79-fdbb901d1505 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:35.718903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d49332da-672f-4d1b-bde6-8b2426dc5108 req-75ec17fe-1123-493d-ba79-fdbb901d1505 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:35.739514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-d49332da-672f-4d1b-bde6-8b2426dc5108 req-75ec17fe-1123-493d-ba79-fdbb901d1505 service nova] Creating event network-vif-unplugged:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:17:35.746924 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-d49332da-672f-4d1b-bde6-8b2426dc5108 req-75ec17fe-1123-493d-ba79-fdbb901d1505 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040845 Sep 23 03:17:35.752396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 403/802] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:35.847175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:35.850589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:35.865827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:35.869727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:35.870553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:35.870999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:36.040942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:36.061451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:36.063244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:36.065077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-64b48151-476e-4353-bdcf-99cf80d0c80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1721 microversion: 2.20 time: 0.228814 Sep 23 03:17:36.080089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 400/803] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:35 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:36.445970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:36.446811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:36.461558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:36.462216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:36.463154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:36.463751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:36.707430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:36.715366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ec075c5d-3b30-4a99-8193-b17fd92a0632 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1512 microversion: 2.1 time: 0.275831 Sep 23 03:17:36.727840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 404/804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:36 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:37.083946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:37.090032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:37.094613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.095062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.095845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.096274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.125783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-940bb5f4-953a-4cd6-839a-b55936c237e7 req-c3ca0bbc-8582-4f93-a293-674a69ffb9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565f86c9-78ca-4856-9083-6ed4db043086", "name": "network-vif-deleted", "tag": "c5c1a228-41bc-4fd1-9c8e-6b4d92214b55"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:37.127624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:17:37.127624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:17:37.135412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-940bb5f4-953a-4cd6-839a-b55936c237e7 req-c3ca0bbc-8582-4f93-a293-674a69ffb9cb service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.135845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-940bb5f4-953a-4cd6-839a-b55936c237e7 req-c3ca0bbc-8582-4f93-a293-674a69ffb9cb service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.147984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-940bb5f4-953a-4cd6-839a-b55936c237e7 req-c3ca0bbc-8582-4f93-a293-674a69ffb9cb service nova] Creating event network-vif-deleted:c5c1a228-41bc-4fd1-9c8e-6b4d92214b55 for instance 565f86c9-78ca-4856-9083-6ed4db043086 on hv-cinder-76845 Sep 23 03:17:37.153530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-940bb5f4-953a-4cd6-839a-b55936c237e7 req-c3ca0bbc-8582-4f93-a293-674a69ffb9cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031546 Sep 23 03:17:37.158654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 405/805] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:17:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:17:37.261657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:37.271735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:37.273638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:37.275219 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b6353ea7-f4ef-4daf-a322-5f2e50bcbdce tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1721 microversion: 2.20 time: 0.196235 Sep 23 03:17:37.286693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 401/806] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:37 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:37.736957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:37.738598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:37.745266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.745717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.746529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.746961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.781784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:37.782222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:37.782767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lazy-loading 'fault' on Instance uuid 565f86c9-78ca-4856-9083-6ed4db043086 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:17:37.828910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36893da01a1845f5af4921a298abb9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0db8b321a54de5ae011d51e6e69a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:37.835864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-039e5f2e-8f5a-4ee1-a390-0584449e7783 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 200 len: 1307 microversion: 2.1 time: 0.104153 Sep 23 03:17:37.837274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 406/807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:37 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:17:38.303400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:38.304094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:38.315998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.316831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.317816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.318427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.473863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:38.496480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:38.502142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:38.503827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3a2e265b-fa79-4460-98f1-6d74f04fcbaa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1724 microversion: 2.20 time: 0.214425 Sep 23 03:17:38.521910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa1aefea-eb24-46f4-8e6b-9183585e5c8c"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:38.523960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:38.528573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 402/808] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:38 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:38.531484 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.532761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.533752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.534339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.853321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:38.854002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] [instance: 565f86c9-78ca-4856-9083-6ed4db043086] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:38.861046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.861784 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.862906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:38.863550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:38.878961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] HTTP exception thrown: Instance 565f86c9-78ca-4856-9083-6ed4db043086 could not be found. Sep 23 03:17:38.879550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] Returning 404 to user: Instance 565f86c9-78ca-4856-9083-6ed4db043086 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:17:38.880412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0b855be9-73e5-4a55-9be3-0588d93ec922 tempest-AttachVolumeNegativeTest-1967980337 tempest-AttachVolumeNegativeTest-1967980337-project] 10.222.0.23 "GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086" status: 404 len: 111 microversion: 2.1 time: 0.031149 Sep 23 03:17:38.881140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 403/809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:17:38 2021] GET /compute/v2.1/servers/565f86c9-78ca-4856-9083-6ed4db043086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:17:39.584925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9bd00e9b-3cce-4184-981a-64963ba127f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.066703 Sep 23 03:17:39.585701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 407/810] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Sep 23 03:17:38 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments => generated 188 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:17:39.883145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:17:39.883772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:39.889624 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:39.891996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:39.891996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:39.891996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:40.218379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bcf88b86-c0b1-4fe0-9c32-b1e8521b79a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action" status: 202 len: 0 microversion: 2.20 time: 0.338816 Sep 23 03:17:40.223070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 404/811] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:17:39 2021] POST /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:17:40.228016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:40.228785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:40.237281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:40.237992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:40.238938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:40.239529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:40.504002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:40.528035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:40.530138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:40.531472 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ded96469-18ef-477a-9f3d-981e5ee3e45e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1750 microversion: 2.20 time: 0.307124 Sep 23 03:17:40.533128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 408/812] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:40 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1750 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:41.550759 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:41.551566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:41.561044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:41.561621 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:41.562520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:41.568146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:41.741678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:41.754197 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:41.758657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:41.759904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-99e913f4-1c31-437f-9298-9159df9e8ae3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1750 microversion: 2.20 time: 0.213172 Sep 23 03:17:41.779666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 405/813] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:41 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:42.788389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:42.789028 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:42.801330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:42.802050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:42.802988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:42.803568 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:43.133455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:43.149430 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:43.156699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:43.164579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-766a4f6c-2345-4149-96ff-965718fba185 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1752 microversion: 2.20 time: 0.376835 Sep 23 03:17:43.165961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 409/814] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:42 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1752 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:44.185394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:44.186105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:44.195225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:44.195671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:44.196557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:44.197420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:44.361376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:44.371244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:44.373188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:44.376153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6ae028ec-5613-4343-b388-a0baebd1e66c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.194553 Sep 23 03:17:44.376153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 406/815] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:44 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:45.395792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:45.397278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:45.404287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:45.405253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:45.406270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:45.407638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:45.571692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:45.582184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:45.583808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:45.585068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-588426ee-8792-455f-886f-acc9a66e1367 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.193774 Sep 23 03:17:45.585944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 410/816] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:45 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:46.603775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:46.604380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:46.618620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:46.621675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:46.621675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:46.621675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:46.987070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:47.002578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:47.004067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:47.020677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-70600c11-3f13-4896-b5e1-c5d14f157841 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.421241 Sep 23 03:17:47.021270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 407/817] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:46 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:48.037958 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:48.038807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:48.048435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:48.048955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:48.049844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:48.050383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:48.395909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:48.412011 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:48.419171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:48.421052 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ab03c65a-410a-4c2f-aaf9-d75ff54de42a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.386970 Sep 23 03:17:48.425717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 411/818] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:48 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:49.443139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:49.443981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:49.462434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:49.463171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:49.464122 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:49.464732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:49.684653 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:49.694516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:49.697799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:49.701576 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8f483991-81cf-434b-acc4-ef3321159f2c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.261475 Sep 23 03:17:49.703438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 408/819] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:49 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:50.721402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:50.722001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:50.730986 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:50.731648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:50.732705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:50.733314 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:50.880229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:50.888755 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:50.890547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:50.892516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e4b4fc16-e613-4703-8f8e-0759fb1527c2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.175395 Sep 23 03:17:50.905601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 412/820] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:50 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:51.913150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:51.913779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:51.933240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:51.933240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:51.934060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:51.935843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:52.134922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:52.146542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:52.148448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:52.150149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6c130bff-f971-4f08-967b-cfbeb6eac3f3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.240678 Sep 23 03:17:52.151933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 409/821] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:51 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:53.168804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:53.169407 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:53.175344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:53.175847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:53.180526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:53.180526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:53.326950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:53.336012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:53.337544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:53.338903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f89bbfba-5246-4578-92dc-0b2efd110319 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.173804 Sep 23 03:17:53.339632 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 413/822] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:53 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:54.357208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:54.362686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:54.368513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:54.368513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:54.369705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:54.370851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:54.882739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:54.892814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:54.895802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:54.902054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4f1854bb-5142-4f3c-b7cf-a1c3dd44eed5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.544439 Sep 23 03:17:54.917252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 410/823] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:54 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:55.926243 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:55.927653 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:55.934118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:55.934569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:55.935687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:55.936292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:56.193872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:56.204292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:56.206162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:56.207348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e84ab315-fbbd-4a1a-afb1-ea7fc016a01f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.285376 Sep 23 03:17:56.208184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 414/824] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:55 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:57.231355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:57.232291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:57.239639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:57.240178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:57.241057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:57.241558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:57.369098 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:57.391109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:57.391109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:57.391109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d848f311-6a3f-484d-b85c-f27e3cb2403e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.159096 Sep 23 03:17:57.391616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 411/825] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:57 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:58.408274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:58.408907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:58.414863 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:58.415302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:58.416080 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:58.416520 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:58.591021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:58.602877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:58.602877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:58.603922 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f6fe6fde-4b04-46e2-aa8b-8c2ac9c4bcd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.199894 Sep 23 03:17:58.614464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 415/826] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:58 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:17:59.624694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:17:59.624694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:17:59.636424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:59.636424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:59.636424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:17:59.636424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:17:59.765941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:59.770426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:59.772568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:17:59.773995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-96806ba6-fbeb-48ef-a048-8c9fa2c1f7c9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.154575 Sep 23 03:17:59.784556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 412/827] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:17:59 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:00.791308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:00.792508 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:00.798535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:00.800338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:00.800338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:00.800338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:00.954722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:00.964364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:00.966477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:00.967843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-40395802-30d1-455e-8b42-b5e6d3e6eab4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.180236 Sep 23 03:18:00.968577 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 416/828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:00 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:01.986587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:01.987192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:01.992935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:01.993379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:01.994132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:01.994552 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:02.128006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:02.138076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:02.139476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:02.141215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8ead4b94-ea40-45c0-8728-710e46c55b0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.157676 Sep 23 03:18:02.141758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 413/829] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:01 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:03.159323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:03.159798 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:03.165663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:03.166033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:03.166799 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:03.167234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:03.289625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:03.301551 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:03.303042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:03.304185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-85389919-8954-4d2d-9ce1-c1914e971646 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.149179 Sep 23 03:18:03.306846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 417/830] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:03 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:03.712443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2143150440", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "9d69a229-2f8b-4f4a-860b-5cb5f3086768"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:18:03.764150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] validate_networks() for [('9d69a229-2f8b-4f4a-860b-5cb5f3086768', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:18:04.233142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:18:04.233616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:18:04.235054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:18:04.236158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:18:04.236158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:18:04.245279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:04.245785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:04.246572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:04.246986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:04.265917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Getting quotas for project d342da2ccebe4ccf9d40607782e2eb54. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:18:04.270146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Getting quotas for user db531f61fb2a405baec24793c54c9538 and project d342da2ccebe4ccf9d40607782e2eb54. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:18:04.282282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:18:04.284609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:18:04.387355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c3dc8ba8-8c21-461d-947c-004015644b35 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678527 Sep 23 03:18:04.388269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 414/831] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:18:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:18:04.398176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-db4335a6-0d62-4e08-83d2-5a65974a3758 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:04.399024 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-db4335a6-0d62-4e08-83d2-5a65974a3758 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:04.452998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-db4335a6-0d62-4e08-83d2-5a65974a3758 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:04.459719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-db4335a6-0d62-4e08-83d2-5a65974a3758 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1219 microversion: 2.1 time: 0.065270 Sep 23 03:18:04.460464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 415/832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:04 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:04.502806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:04.503412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:04.509414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:04.509941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:04.510701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:04.511127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:04.642235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:04.650499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:04.657539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:04.657539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-27062900-6221-41e1-b0de-6acf6734a0f1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.332496 Sep 23 03:18:04.657539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 418/833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:04 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:05.476094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6b197931-2ac1-42f0-b526-015f10b2dc01 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:05.476722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6b197931-2ac1-42f0-b526-015f10b2dc01 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:05.527738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6b197931-2ac1-42f0-b526-015f10b2dc01 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:05.535304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6b197931-2ac1-42f0-b526-015f10b2dc01 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1219 microversion: 2.1 time: 0.063139 Sep 23 03:18:05.536035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 416/834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:05 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:05.670914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:05.671621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:05.678003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:05.678445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:05.679200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:05.679790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:05.802962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:05.816563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:05.817187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:05.818440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4dd409b7-1f86-4a31-b7d3-f21807fa9ae6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.151324 Sep 23 03:18:05.819266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 419/835] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:05 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:18:06.552033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:06.552704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:06.562988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:06.562988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:06.562988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:06.562988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:06.627076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:06.634510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3694e9cc-1aa7-4e81-94f4-b108ed72b7e8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1271 microversion: 2.1 time: 0.086070 Sep 23 03:18:06.636690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 417/836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:06 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:06.836193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:06.836830 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:06.842871 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:06.843321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:06.844212 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:06.844678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:07.058915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:07.072271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:07.074001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:07.075819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e858dfd1-2f89-4f9f-9440-2779791c0649 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.243244 Sep 23 03:18:07.076385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 420/837] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:06 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:18:07.651243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:07.651875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:07.657844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:07.658291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:07.659042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:07.659634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:07.722142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:07.729549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4b27b38e-9cd0-419f-bae1-ae8b3d76e86c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1277 microversion: 2.1 time: 0.082194 Sep 23 03:18:07.730101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 418/838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:07 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:08.095716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:08.096940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:08.102807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:08.103442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:08.104467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:08.105006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:08.379354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:08.388893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:08.390970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:08.395660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-06c8e278-6530-437a-b14b-4ce247ce244c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.304581 Sep 23 03:18:08.397576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 421/839] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:08 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:08.746856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:08.747537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:08.754470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:08.754987 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:08.755817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:08.756316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:08.882085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:08.889393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-69446963-487f-4ad2-b789-d4140ea0b813 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.146179 Sep 23 03:18:08.889953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 419/840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:08 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:08.962264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-c3f48f60-d4dc-46f7-8270-7ca7b618f377 req-3aa1b830-47d8-4742-8e8f-f768392a3282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7f885b-e7bc-4b70-8e19-73f366ccd543", "tag": "cbbfbf44-4f8f-4822-af37-72c6972a6b0a"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:18:08.964056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:18:08.964056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:18:08.971478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-c3f48f60-d4dc-46f7-8270-7ca7b618f377 req-3aa1b830-47d8-4742-8e8f-f768392a3282 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:08.971923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-c3f48f60-d4dc-46f7-8270-7ca7b618f377 req-3aa1b830-47d8-4742-8e8f-f768392a3282 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:08.982796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-c3f48f60-d4dc-46f7-8270-7ca7b618f377 req-3aa1b830-47d8-4742-8e8f-f768392a3282 service nova] Creating event network-changed:cbbfbf44-4f8f-4822-af37-72c6972a6b0a for instance 6f7f885b-e7bc-4b70-8e19-73f366ccd543 on hv-cinder-76845 Sep 23 03:18:08.987976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-c3f48f60-d4dc-46f7-8270-7ca7b618f377 req-3aa1b830-47d8-4742-8e8f-f768392a3282 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029563 Sep 23 03:18:08.988851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 422/841] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:18:09.414602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:09.415340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:09.423746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:09.424200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:09.425033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:09.425462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:09.599006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:09.608014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:09.609924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:09.611257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2eb979f0-22d3-4f77-b9dd-c9c969d20d9a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.200904 Sep 23 03:18:09.612311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 420/842] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:09 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:09.907620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:09.908322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:09.914797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:09.915231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:09.915992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:09.916414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:10.074525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:10.083304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c615aeef-95a0-41c2-937a-df9d2059073d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.180769 Sep 23 03:18:10.083873 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 423/843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:09 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:10.629477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:10.630954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:10.637531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:10.638115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:10.639023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:10.639530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:10.771850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:10.780802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:10.782325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:10.783914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f37d7d77-2c4d-4caa-847a-736d7df1f4b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.158780 Sep 23 03:18:10.784402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 421/844] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:11.099265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:11.100455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:11.105780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:11.109004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:11.109004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:11.109004 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:11.235811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:11.243542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-92ae8ca5-af13-4540-b3cc-6828ca1c8fec tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.147794 Sep 23 03:18:11.244163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 424/845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:11 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:11.801809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:11.802416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:11.816007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:11.816722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:11.823617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:11.823617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:11.855480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-983c5d3c-52ef-49db-9aca-bd9a8edf7562 req-28fbf723-024e-4a2b-957a-a7204f39fc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "name": "network-vif-plugged", "status": "completed", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:18:11.857349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:18:11.857349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:18:11.866305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-983c5d3c-52ef-49db-9aca-bd9a8edf7562 req-28fbf723-024e-4a2b-957a-a7204f39fc8e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:11.867386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-983c5d3c-52ef-49db-9aca-bd9a8edf7562 req-28fbf723-024e-4a2b-957a-a7204f39fc8e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:11.880034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-983c5d3c-52ef-49db-9aca-bd9a8edf7562 req-28fbf723-024e-4a2b-957a-a7204f39fc8e service nova] Creating event network-vif-plugged:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:18:11.886221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-983c5d3c-52ef-49db-9aca-bd9a8edf7562 req-28fbf723-024e-4a2b-957a-a7204f39fc8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Sep 23 03:18:11.886872 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 425/846] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:18:12.011168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:12.019602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:12.021782 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:12.023162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-225e4443-f7db-402c-a8bf-05e3b4bafc24 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.225025 Sep 23 03:18:12.030131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 422/847] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:11 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:12.260984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:12.261672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:12.268233 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:12.268698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:12.269714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:12.270145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:12.392346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:12.400025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e4a90b65-f9cd-4952-8d68-c511d595ad99 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.143209 Sep 23 03:18:12.402009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 426/848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:12 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:13.047912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:13.048525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:13.054362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:13.054800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:13.055545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:13.055967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:13.187741 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:13.195829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:13.197358 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:13.198500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-481a22b9-b881-47f5-b264-96df87d47209 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.154287 Sep 23 03:18:13.199048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 423/849] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:13 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:18:13.419043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:13.419566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:13.425389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:13.425857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:13.426620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:13.427048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:13.546649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:13.553718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3e9a6bde-2144-49e9-83d3-4cf373386703 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.138407 Sep 23 03:18:13.554459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 427/850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:13 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:14.216932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:14.217496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:14.224061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:14.224722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:14.225490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:14.226090 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:14.364464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:14.373817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:14.376386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:14.378084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1fa7d7cb-736e-45c8-af9f-cf31b3c6ce8d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.164658 Sep 23 03:18:14.378859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 424/851] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:14 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:14.571543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:14.572532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:14.586029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:14.586930 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:14.587904 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:14.590836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:14.770501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:14.780107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5ac65b62-9a35-443f-a1e6-8d1470c4965f tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.212961 Sep 23 03:18:14.783040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 428/852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:14 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:15.395856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:15.396469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:15.404055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:15.404567 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:15.405406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:15.405930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:15.535080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:15.543389 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:15.544910 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:15.546060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d8ea0180-5209-4170-993f-9027d2c036f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1808 microversion: 2.20 time: 0.153997 Sep 23 03:18:15.546644 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 425/853] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:15 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:15.797891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:15.798492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:15.805213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:15.805973 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:15.806857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:15.807412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:15.961421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-ada13173-f39c-4707-8a7e-9609a41289f8 req-aed495d0-1a67-430e-bd1c-c31c4743c9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7f885b-e7bc-4b70-8e19-73f366ccd543", "name": "network-vif-plugged", "status": "completed", "tag": "cbbfbf44-4f8f-4822-af37-72c6972a6b0a"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:18:15.961669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:15.963031 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:18:15.963031 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:18:15.970319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fa6af71d-22bf-408a-a68d-048b44e90f7c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.177206 Sep 23 03:18:15.971375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 429/854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:15 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:15.975004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-ada13173-f39c-4707-8a7e-9609a41289f8 req-aed495d0-1a67-430e-bd1c-c31c4743c9b0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:15.975442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-ada13173-f39c-4707-8a7e-9609a41289f8 req-aed495d0-1a67-430e-bd1c-c31c4743c9b0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:15.989257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-ada13173-f39c-4707-8a7e-9609a41289f8 req-aed495d0-1a67-430e-bd1c-c31c4743c9b0 service nova] Creating event network-vif-plugged:cbbfbf44-4f8f-4822-af37-72c6972a6b0a for instance 6f7f885b-e7bc-4b70-8e19-73f366ccd543 on hv-cinder-76845 Sep 23 03:18:15.994893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-ada13173-f39c-4707-8a7e-9609a41289f8 req-aed495d0-1a67-430e-bd1c-c31c4743c9b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038086 Sep 23 03:18:15.995429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 426/855] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:18:16.563424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:16.564025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:16.569780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:16.570218 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:16.570972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:16.571523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:16.698165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:16.706834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:16.708415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:16.709613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2f7d52bd-c13e-423c-86ca-41a0cdb27ca8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1795 microversion: 2.20 time: 0.150416 Sep 23 03:18:16.710196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 430/856] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:18:16 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1795 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:18:16.988413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:16.989060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:16.995601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:16.996151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:16.997030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:16.997523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:17.140857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:17.148409 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-96558559-d947-4333-b70e-08e8e00cc712 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.164589 Sep 23 03:18:17.149305 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 427/857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:16 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:18.165595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:18.166840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:18.174962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:18.175821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:18.177831 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:18.178982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:18.309282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:18.316657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c1f08819-3a0c-4a92-a38f-2327731e6e9d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1319 microversion: 2.1 time: 0.155000 Sep 23 03:18:18.317217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 431/858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:18 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:19.333231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:18:19.333843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:19.339758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:19.340205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:19.340990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:19.341423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:19.528287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:18:19.535672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c041965f-2a12-4a65-be37-38b12e8b0d5e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1508 microversion: 2.1 time: 0.206224 Sep 23 03:18:19.536381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 428/859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:18:19 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:18:49.764350 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2138262-a095-4e50-ba17-d25f574c6144", "device": "/dev/sdb"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:18:49.765961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:18:49.772056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:49.772512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:49.773326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:18:49.773751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:18:50.594936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e65b9ec7-728b-44e7-bd9f-508fc9790139 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "POST /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834182 Sep 23 03:18:50.598748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 432/860] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:18:49 2021] POST /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:19:25.525819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 03:19:25.529625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:25.530108 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:25.535791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:25.536231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:25.537013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:25.537437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:25.619552 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lazy-loading 'services' on Instance uuid 6f7f885b-e7bc-4b70-8e19-73f366ccd543 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:19:25.824006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-03de7070-593d-4b59-95be-38c6d6857c91 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543/os-volume_attachments/e2138262-a095-4e50-ba17-d25f574c6144" status: 202 len: 0 microversion: 2.1 time: 0.299931 Sep 23 03:19:25.824624 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 429/861] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:19:25 2021] DELETE /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543/os-volume_attachments/e2138262-a095-4e50-ba17-d25f574c6144 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:19:28.000394 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:28.000991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:28.006982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:28.007448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:28.008203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:28.008745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:28.033283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:19:28.327979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-567f0617-510b-4c82-8e58-01627811dd60 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 204 len: 0 microversion: 2.1 time: 0.332451 Sep 23 03:19:28.328588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 433/862] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:19:27 2021] DELETE /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:19:28.349027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:28.349716 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:28.357799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:28.358224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:28.359030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:28.359457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:28.364555 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33204. Sep 23 03:19:28.481253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:28.488605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-40dd294a-698d-4bfe-9297-be0c821eb18d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1514 microversion: 2.1 time: 0.155459 Sep 23 03:19:28.489168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 430/863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:28 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:29.506751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:29.507442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:29.513792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:29.514235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:29.514993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:29.515420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:29.636558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:29.644465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9e7e7f8a-118f-45ec-88ea-0b1c6c54c3e2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1514 microversion: 2.1 time: 0.141747 Sep 23 03:19:29.645052 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 434/864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:29 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:30.660743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:30.661351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:30.667468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:30.675325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:30.675325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:30.675325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:30.788001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:30.796177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-64b38050-8f7f-4984-9245-83bc546b62bb tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1514 microversion: 2.1 time: 0.139153 Sep 23 03:19:30.796778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 431/865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:30 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:31.371332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-16acad40-eed3-4746-8d58-6e5624b69f22 req-d40ba071-0ac6-4719-856f-74e29fe0b05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7f885b-e7bc-4b70-8e19-73f366ccd543", "name": "network-vif-deleted", "tag": "cbbfbf44-4f8f-4822-af37-72c6972a6b0a"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:19:31.373514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:19:31.373514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:19:31.380243 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-16acad40-eed3-4746-8d58-6e5624b69f22 req-d40ba071-0ac6-4719-856f-74e29fe0b05f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:31.380723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-16acad40-eed3-4746-8d58-6e5624b69f22 req-d40ba071-0ac6-4719-856f-74e29fe0b05f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:31.391704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-16acad40-eed3-4746-8d58-6e5624b69f22 req-d40ba071-0ac6-4719-856f-74e29fe0b05f service nova] Creating event network-vif-deleted:cbbfbf44-4f8f-4822-af37-72c6972a6b0a for instance 6f7f885b-e7bc-4b70-8e19-73f366ccd543 on hv-cinder-76845 Sep 23 03:19:31.396451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-16acad40-eed3-4746-8d58-6e5624b69f22 req-d40ba071-0ac6-4719-856f-74e29fe0b05f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149200 Sep 23 03:19:31.397062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 435/866] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:19:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:19:31.813528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:31.814140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:31.819985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:31.822224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:31.822224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:31.822224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:31.850700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:31.851131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:31.851571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lazy-loading 'fault' on Instance uuid 6f7f885b-e7bc-4b70-8e19-73f366ccd543 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:19:31.891955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:31.899224 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fb256283-17fc-42b5-bb8a-d7c4d0ca4f94 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 200 len: 1309 microversion: 2.1 time: 0.089954 Sep 23 03:19:31.899782 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 432/867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:31 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:32.920920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:32.921617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: 6f7f885b-e7bc-4b70-8e19-73f366ccd543] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:32.927502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:32.927944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:32.928725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:32.929175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:32.941741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] HTTP exception thrown: Instance 6f7f885b-e7bc-4b70-8e19-73f366ccd543 could not be found. Sep 23 03:19:32.942313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Returning 404 to user: Instance 6f7f885b-e7bc-4b70-8e19-73f366ccd543 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:19:32.943108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a8aee9d1-42a5-4f82-94f3-aa05ea83acd6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543" status: 404 len: 111 microversion: 2.1 time: 0.026836 Sep 23 03:19:32.943614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 436/868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:32 2021] GET /compute/v2.1/servers/6f7f885b-e7bc-4b70-8e19-73f366ccd543 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:19:37.922772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:19:37.923295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:19:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:19:44.389468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:19:44.390133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:19:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:19:50.456393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2049197305", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "networks": [{"uuid": "9d69a229-2f8b-4f4a-860b-5cb5f3086768"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:19:50.517571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] validate_networks() for [('9d69a229-2f8b-4f4a-860b-5cb5f3086768', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:19:50.850036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:19:50.850586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:19:50.851140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:19:50.851600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:19:50.852003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:19:50.862222 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:50.862753 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:50.863575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:50.864084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:50.883261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Getting quotas for project d342da2ccebe4ccf9d40607782e2eb54. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:19:50.887047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Getting quotas for user db531f61fb2a405baec24793c54c9538 and project d342da2ccebe4ccf9d40607782e2eb54. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:19:50.897819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:19:50.900078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:19:51.012861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-08979f00-47b5-4350-a882-0c7e9193ddaf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560090 Sep 23 03:19:51.013495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 433/869] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:19:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:19:51.023077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-27175b24-1e36-431f-b729-8b6f246bda47 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:51.023693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-27175b24-1e36-431f-b729-8b6f246bda47 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:51.079835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-27175b24-1e36-431f-b729-8b6f246bda47 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:51.086396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-27175b24-1e36-431f-b729-8b6f246bda47 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1219 microversion: 2.1 time: 0.067014 Sep 23 03:19:51.086991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 437/870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:51 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:19:52.103082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:52.103696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:52.110387 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:52.110827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:52.111579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:52.112009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:52.177618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:52.185423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-db849f94-ea25-4829-936d-a96707e941f6 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1215 microversion: 2.1 time: 0.085504 Sep 23 03:19:52.189930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 434/871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:52 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:53.201783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:53.202389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:53.208281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:53.208756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:53.209544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:53.209971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:53.270194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:53.277517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-67f4f5db-317e-4f79-9ecb-e56b1c05e9cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1277 microversion: 2.1 time: 0.079442 Sep 23 03:19:53.278671 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 438/872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:53 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:54.297311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:54.297914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:54.305222 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:54.306323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:54.307083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:54.307505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:54.428820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:54.436860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-80c1b1fe-f99f-4e6a-89fb-ee67a28f15bf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.146484 Sep 23 03:19:54.437431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 435/873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:54 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:54.570609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-a719e46f-de14-49d2-af02-9540824a38eb req-007b8980-da07-497a-ae12-5240ef2d8e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecb666b-0d0f-4416-bac8-024b960441f3", "tag": "83d67bae-4f42-47b4-8a93-967380933503"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:19:54.572235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:19:54.572235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:19:54.579117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a719e46f-de14-49d2-af02-9540824a38eb req-007b8980-da07-497a-ae12-5240ef2d8e7d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:54.579558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a719e46f-de14-49d2-af02-9540824a38eb req-007b8980-da07-497a-ae12-5240ef2d8e7d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:54.592459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-a719e46f-de14-49d2-af02-9540824a38eb req-007b8980-da07-497a-ae12-5240ef2d8e7d service nova] Creating event network-changed:83d67bae-4f42-47b4-8a93-967380933503 for instance aecb666b-0d0f-4416-bac8-024b960441f3 on hv-cinder-76845 Sep 23 03:19:54.597264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-a719e46f-de14-49d2-af02-9540824a38eb req-007b8980-da07-497a-ae12-5240ef2d8e7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 Sep 23 03:19:54.597885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 439/874] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:19:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:19:55.453876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:55.454484 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:55.460291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:55.460769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:55.461539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:55.461967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:55.577486 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:55.587032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-67ed0704-26c8-4457-b63f-07960ebecc3e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.137406 Sep 23 03:19:55.587600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 436/875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:55 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:56.611246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:56.611939 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:56.618316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:56.618757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:56.619512 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:56.619967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:56.739507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:56.746810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2fbad345-6a03-4c43-abdb-962ae03c3b86 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.139539 Sep 23 03:19:56.747895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 440/876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:56 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:57.763387 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:57.763987 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:57.770041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:57.770512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:57.771282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:57.771704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:57.896249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:57.903368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4001b2a3-2695-40b8-9592-811b133a3fb9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.144159 Sep 23 03:19:57.903934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 437/877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:57 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:19:58.921466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:19:58.922077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:19:58.928380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:58.928847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:58.929615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:19:58.930046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:19:59.133791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:19:59.140792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3e0f15b8-7e2d-4d2a-b14d-ba5f3bee36f4 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.223469 Sep 23 03:19:59.141352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 441/878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:19:58 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:00.156986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:00.157531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:00.163401 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:00.163842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:00.164617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:00.165093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:00.285050 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:00.292291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d54af2a9-f846-452d-bb68-19587225277c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.139028 Sep 23 03:20:00.296530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 438/879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:00 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:01.309485 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:01.310183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:01.316266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:01.316748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:01.317514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:01.317940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:01.437999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:01.445320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b65f5f6b-c5d7-410a-9f0b-8537ce4d087d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.139651 Sep 23 03:20:01.446120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 442/880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:01 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:02.461316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:02.461943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:02.467806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:02.468243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:02.469009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:02.469434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:02.589611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:02.597271 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1d3f2779-3d95-451e-a6dd-c04bd32d1118 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.139562 Sep 23 03:20:02.597891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 439/881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:02 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:03.618252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:03.618786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:03.625171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:03.625605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:03.626350 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:03.626771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:03.749875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:03.757012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2cc91d85-7920-4159-b8d7-418b74a74cbc tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.142506 Sep 23 03:20:03.757558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 443/882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:03 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:04.773702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:04.774305 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:04.780069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:04.782269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:04.782269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:04.782269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:04.903420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:04.910593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7850ab44-2f1d-4932-904b-429b539e4ec2 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.140575 Sep 23 03:20:04.911157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 440/883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:04 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:05.927249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:05.928140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:05.934928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:05.935404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:05.936158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:05.936864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.060358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:06.068549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1603e198-e520-4320-9a8c-37ed91e0f06e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.145100 Sep 23 03:20:06.069113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 444/884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:05 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:06.554842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:06.556027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:06.563530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:06.563843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.565116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:06.565713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.600842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5329e67c-bf0c-4aa0-afa3-f64af239c211 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments/fa1aefea-eb24-46f4-8e6b-9183585e5c8c" status: 200 len: 194 microversion: 2.20 time: 0.050249 Sep 23 03:20:06.601478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 441/885] 10.222.0.23 () {60 vars in 1454 bytes} [Thu Sep 23 03:20:06 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments/fa1aefea-eb24-46f4-8e6b-9183585e5c8c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:20:06.680708 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:06.681196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:06.686999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:06.687442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.688206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:06.688666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.714941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-d70d5fa0-3ae9-4ca3-8675-d4f57d05d93e req-1af52be6-d35a-4e8b-8299-900b36684baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecb666b-0d0f-4416-bac8-024b960441f3", "name": "network-vif-plugged", "status": "completed", "tag": "83d67bae-4f42-47b4-8a93-967380933503"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:06.717287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:06.717287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:20:06.724217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d70d5fa0-3ae9-4ca3-8675-d4f57d05d93e req-1af52be6-d35a-4e8b-8299-900b36684baa service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:06.724740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d70d5fa0-3ae9-4ca3-8675-d4f57d05d93e req-1af52be6-d35a-4e8b-8299-900b36684baa service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:06.737884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-d70d5fa0-3ae9-4ca3-8675-d4f57d05d93e req-1af52be6-d35a-4e8b-8299-900b36684baa service nova] Creating event network-vif-plugged:83d67bae-4f42-47b4-8a93-967380933503 for instance aecb666b-0d0f-4416-bac8-024b960441f3 on hv-cinder-76845 Sep 23 03:20:06.745213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-d70d5fa0-3ae9-4ca3-8675-d4f57d05d93e req-1af52be6-d35a-4e8b-8299-900b36684baa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179904 Sep 23 03:20:06.746269 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 445/886] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:20:06.777300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lazy-loading 'services' on Instance uuid 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:20:07.043317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2d5855df-3485-4cfa-9986-a21258be9fdd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments/fa1aefea-eb24-46f4-8e6b-9183585e5c8c" status: 202 len: 0 microversion: 2.20 time: 0.364227 Sep 23 03:20:07.043317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 442/887] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Sep 23 03:20:06 2021] DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments/fa1aefea-eb24-46f4-8e6b-9183585e5c8c => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 03:20:07.052864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:07.054070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:07.060654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:07.061194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:07.061949 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:07.062383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:07.086463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:07.087264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:07.093849 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f722f3ec-7fcc-4994-9573-744ecadc396a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045884 Sep 23 03:20:07.094455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 446/888] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Sep 23 03:20:07 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:20:07.105699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:07.105699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:07.105699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:07.105699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:07.249922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:07.257599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-81629ee6-5e7f-456f-943e-5891e01f2800 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.175447 Sep 23 03:20:07.258198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 443/889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:07 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:08.105808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:08.106779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:08.112473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:08.112945 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:08.113702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:08.114132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:08.143792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7a02fc28-5eff-4968-8213-05862b6ba69c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 Sep 23 03:20:08.144331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 447/890] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Sep 23 03:20:08 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:20:08.274408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:08.275006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:08.281161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:08.281595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:08.282333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:08.282755 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:08.416117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:08.424768 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-dac73fd0-2140-4b8d-a30a-ae4e2f588609 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.153880 Sep 23 03:20:08.425336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 444/891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:08 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:09.155934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:09.157016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:09.163463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:09.163880 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:09.164688 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:09.165112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:09.194475 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37165d80-0b99-4996-ae1c-ffc380524a7b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042997 Sep 23 03:20:09.195035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 448/892] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Sep 23 03:20:09 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:20:09.441645 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:09.442350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:09.448505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:09.448964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:09.450217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:09.450648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:09.570166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:09.577871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d2755d62-130d-4126-bcc2-4cca189e35d8 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1319 microversion: 2.1 time: 0.140235 Sep 23 03:20:09.580905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 445/893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:09 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:10.206033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:10.206935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:10.212745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.213191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.213971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.214399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.242745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e6166c37-f36f-4f84-b139-ea57b0f36f57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040539 Sep 23 03:20:10.243287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 449/894] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Sep 23 03:20:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:10.302968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:10.303464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:10.309578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.310009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.310768 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.311203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.344047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:20:10.596074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-96ae6823-e72e-44ff-bc0a-33fa2d6ad6a6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 204 len: 0 microversion: 2.20 time: 0.296523 Sep 23 03:20:10.596811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 446/895] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Sep 23 03:20:10 2021] DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:20:10.598583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:10.599196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:10.605235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:10.605864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.606391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.606885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:10.607159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.607763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.612648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.613100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.613861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.614288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.736079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:10.737032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:10.743747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-84fb8cbe-2c19-42e9-a2ac-7d19d1295b4c tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1507 microversion: 2.1 time: 0.153116 Sep 23 03:20:10.744320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 450/896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:10 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:10.745438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:10.746967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:10.748086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1125880d-6817-4e5f-bd8b-1b4c1aaf702b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.146836 Sep 23 03:20:10.749150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 447/897] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:10 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:10.759287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62f30aa9-67ed-4906-87d3-dbd11a814624", "device": "/dev/sdb"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:10.760353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:10.766606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.767042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:10.767785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:10.768208 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:11.502879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-42b28819-6511-414a-aa9c-61cb6de3f7cf tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "POST /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747059 Sep 23 03:20:11.503884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 451/898] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:20:10 2021] POST /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:20:11.766940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:11.767545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:11.773404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:11.773850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:11.774612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:11.775044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:11.898007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:11.906283 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:11.907797 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:11.908986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e6d41966-12cb-4d89-bf12-202594cfcd0c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.146025 Sep 23 03:20:11.909544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 448/899] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:11 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:12.927480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:12.928090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:12.934696 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:12.935138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:12.935897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:12.936324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:13.089611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:13.097921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:13.099447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:13.100566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-70338f44-65b8-4d26-9eb9-e5809a70ee23 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1723 microversion: 2.20 time: 0.177722 Sep 23 03:20:13.101121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 452/900] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:12 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:14.120598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:14.121116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:14.127136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:14.128190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:14.129128 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:14.129606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:14.153991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-f0877302-d07d-49a7-a307-c1bee2ab6cac req-54ff9a97-c3b8-4491-9049-e58a6bab1205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a", "name": "network-vif-deleted", "tag": "a5f2fd12-35d0-4bf0-87db-ab4c96661bc7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:14.156321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:14.156321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:20:14.166606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f0877302-d07d-49a7-a307-c1bee2ab6cac req-54ff9a97-c3b8-4491-9049-e58a6bab1205 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:14.167364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-f0877302-d07d-49a7-a307-c1bee2ab6cac req-54ff9a97-c3b8-4491-9049-e58a6bab1205 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:14.179146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-f0877302-d07d-49a7-a307-c1bee2ab6cac req-54ff9a97-c3b8-4491-9049-e58a6bab1205 service nova] Creating event network-vif-deleted:a5f2fd12-35d0-4bf0-87db-ab4c96661bc7 for instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a on hv-cinder-76845 Sep 23 03:20:14.184576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-f0877302-d07d-49a7-a307-c1bee2ab6cac req-54ff9a97-c3b8-4491-9049-e58a6bab1205 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037970 Sep 23 03:20:14.185371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 453/901] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:20:14.201689 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:14.209563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:14.211051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:14.212187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1a5d6e58-9baf-4499-ae09-1b4bb00a536e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1655 microversion: 2.20 time: 0.096845 Sep 23 03:20:14.212774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 449/902] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:14 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:15.234262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:15.234928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:15.242306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:15.243125 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:15.245169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:15.245935 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:15.281561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:15.282172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:15.282731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lazy-loading 'fault' on Instance uuid 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:20:15.325151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:15.333427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:15.334959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:15.336152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1e097618-b93d-4906-aca8-e8bf29930334 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 200 len: 1371 microversion: 2.20 time: 0.107644 Sep 23 03:20:15.337422 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 454/903] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:15 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:16.355105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:16.358289 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:16.364731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:16.365169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:16.365938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:16.366366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:16.380168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. Sep 23 03:20:16.380785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:20:16.381608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f55ac4b1-17ff-42ac-9831-139bc609c35c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 404 len: 111 microversion: 2.20 time: 0.030311 Sep 23 03:20:16.382146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 450/904] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:16 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:20:16.390678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-93819373-642d-4056-b6fd-5e153dedf5d9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '.version_select at 0x7fd1b40eef70>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:16.517730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-93819373-642d-4056-b6fd-5e153dedf5d9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125703532" status: 204 len: 0 microversion: 2.20 time: 0.130632 Sep 23 03:20:16.518245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 455/905] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Sep 23 03:20:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125703532 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 03:20:17.629236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: .version_select at 0x7fd1b41bfca0>, body: {"keypair": {"name": "tempest-keypair-1836668860"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:17.664360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:20:17.668983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:20:18.136186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:20:18.139925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:20:18.153239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7734f02a-258a-4e77-b915-01dc3a753f5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.527318 Sep 23 03:20:18.153838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 451/906] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Sep 23 03:20:17 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 529 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:20:20.464083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1517623303", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14c1ac36-0e52-4076-99c3-1a39144cff3e"}], "security_groups": [{"name": "tempest-securitygroup--1507388976"}], "key_name": "tempest-keypair-1836668860", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:20.554529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] validate_networks() for [('14c1ac36-0e52-4076-99c3-1a39144cff3e', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:20:21.005461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:20:21.005910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:20:21.006371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:20:21.006768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:20:21.007197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:20:21.016094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:21.016548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:21.017341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:21.017772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:21.033420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for project dbfca1e34b884266a4b529b2813872ba. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:20:21.037302 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Getting quotas for user bea2a7d9c3724d8b947a0a6363d2f5bd and project dbfca1e34b884266a4b529b2813872ba. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:20:21.047708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:20:21.050007 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:20:21.193051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c7a87ea9-13d9-4887-ba86-b48c82238678 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.733603 Sep 23 03:20:21.193622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 456/907] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Sep 23 03:20:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 03:20:21.204105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:21.204770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:21.257974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:21.264867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:21.271048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:21.271048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-08c16af7-c056-4845-89c3-638ca6859a89 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1282 microversion: 2.20 time: 0.067708 Sep 23 03:20:21.271048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 452/908] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:21 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:22.285870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:22.286479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:22.293517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:22.293897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:22.294654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:22.295084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:22.352921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:22.362258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:22.363030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:22.364135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ea54e147-7c71-4688-9002-1e6038c47a57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1286 microversion: 2.20 time: 0.082005 Sep 23 03:20:22.364718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 457/909] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:22 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:23.381790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:23.382403 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:23.388932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:23.389377 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:23.390131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:23.390555 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:23.451028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:23.458745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:23.460223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:23.461332 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e255f5ef-9671-45ee-8ccb-9c02257aa6b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1286 microversion: 2.20 time: 0.083336 Sep 23 03:20:23.461878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 453/910] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:23 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:24.478760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:24.479365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:24.485807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:24.486231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:24.486982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:24.487406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:24.544482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:24.551969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:24.553503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:24.554617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2bf6f38e-dca2-446e-845b-24b67a4ee423 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1286 microversion: 2.20 time: 0.079528 Sep 23 03:20:24.555163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 458/911] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:24 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:25.571906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:25.572531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:25.579053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:25.579493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:25.580243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:25.580698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:25.637454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:25.644869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:25.646349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:25.647421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f93c843e-9bad-4c00-a8d0-688317b8d7fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1286 microversion: 2.20 time: 0.079165 Sep 23 03:20:25.647975 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 454/912] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:25 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:26.664939 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:26.665607 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:26.673853 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:26.674294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:26.677690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:26.677690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:26.734392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:26.742115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:26.743629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:26.744725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f2199c5a-665d-42fd-a84d-be1d83402220 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1286 microversion: 2.20 time: 0.083510 Sep 23 03:20:26.745476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 459/913] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:26 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:27.763641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:27.764236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:27.769945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:27.770389 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:27.771132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:27.771558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:27.840691 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:27.853895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:27.855796 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:27.856922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4116728b-e82f-497f-9367-86c374006d86 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1342 microversion: 2.20 time: 0.097746 Sep 23 03:20:27.857480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 455/914] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:27 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:28.874424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:28.875576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:28.882154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:28.882669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:28.883503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:28.883931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:29.033143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:29.041532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:29.043052 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:29.044148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f593418a-b477-4c67-b35b-9b879499c208 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.173410 Sep 23 03:20:29.044787 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 460/915] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:28 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:29.395309 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-29d1c5a8-7965-4569-ae88-11bc98c6ecc7 req-b8ed6e70-eaca-4d1f-a4ee-b5b3348c51da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:29.397030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:29.397030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:20:29.403891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-29d1c5a8-7965-4569-ae88-11bc98c6ecc7 req-b8ed6e70-eaca-4d1f-a4ee-b5b3348c51da service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:29.404620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-29d1c5a8-7965-4569-ae88-11bc98c6ecc7 req-b8ed6e70-eaca-4d1f-a4ee-b5b3348c51da service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:29.415394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-29d1c5a8-7965-4569-ae88-11bc98c6ecc7 req-b8ed6e70-eaca-4d1f-a4ee-b5b3348c51da service nova] Creating event network-changed:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:20:29.420509 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-29d1c5a8-7965-4569-ae88-11bc98c6ecc7 req-b8ed6e70-eaca-4d1f-a4ee-b5b3348c51da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029228 Sep 23 03:20:29.421108 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 456/916] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:20:30.061961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:30.062556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:30.068254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:30.068833 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:30.069587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:30.070012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:30.186674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:30.194215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:30.195697 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:30.196934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-42dbf7b5-e5bc-4214-8dc4-26c697c678a2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.138490 Sep 23 03:20:30.197494 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 461/917] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:30 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:31.214878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:31.215495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:31.221449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:31.221884 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:31.222627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:31.223048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:31.343057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:31.350648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:31.352139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:31.353259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8ece496d-e26f-470f-9a4d-31aa772955bc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.142406 Sep 23 03:20:31.353818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 457/918] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:31 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:32.371698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:32.372257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:32.377957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:32.378392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:32.379132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:32.379561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:32.499563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:32.507190 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:32.508751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:32.509839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d4060123-77e8-47d3-875a-743de76f64d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.141972 Sep 23 03:20:32.510400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 462/919] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:32 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:33.527976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:33.528544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:33.534398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:33.535323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:33.535727 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:33.536160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:33.674109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:33.681804 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:33.683287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:33.684409 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b3bdba33-6468-49a1-9a67-16c42fa250a9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.160359 Sep 23 03:20:33.684999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 458/920] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:33 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:34.702515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:34.703114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:34.708862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:34.709296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:34.710039 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:34.710462 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:34.831395 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:34.839168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:34.840884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:34.841971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e94da8b6-0cdf-443d-bbf6-b40df2d63a11 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.143801 Sep 23 03:20:34.842523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 463/921] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:34 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:20:35.859785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:35.860534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:35.866393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:35.866912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:35.867674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:35.868102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:35.990170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:35.998164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:35.999649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:36.000927 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1670cdd0-43a4-476e-9414-bfaeacdc611c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.145501 Sep 23 03:20:36.001487 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 459/922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:35 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:37.018130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:37.018738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:37.024517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:37.024975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:37.025738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:37.026172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:37.142624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:37.150225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:37.151758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:37.152884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4067b4c1-094b-4c1d-8087-66c6c55a3c87 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.138470 Sep 23 03:20:37.153452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 464/923] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:37 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:20:38.170392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:38.170924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:38.176783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:38.177227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:38.177979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:38.178407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:38.294452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:38.302001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:38.303473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:38.304582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-578f7fb5-db19-474a-8339-e90f2a2bb1fa tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.137969 Sep 23 03:20:38.305139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 460/924] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:38 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:39.322650 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:39.323262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:39.329084 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:39.329523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:39.330278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:39.330709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:39.447519 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:39.455130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:39.456646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:39.457730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e48c4f81-9cdb-418c-8c7b-3e956a3a6f38 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.138825 Sep 23 03:20:39.458288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 465/925] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:39 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:40.474743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:40.475343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:40.481808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:40.482244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:40.482984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:40.483406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:40.606881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:40.614417 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:40.615888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:40.617020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-19c8adb4-2c76-47f9-b732-d64c928413f9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.145907 Sep 23 03:20:40.617569 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 461/926] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:40 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:40.677828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:40.678340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:40.684116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:40.684584 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:40.685331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:40.685753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:40.767173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lazy-loading 'services' on Instance uuid aecb666b-0d0f-4416-bac8-024b960441f3 {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:20:41.005802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-553db848-2c23-49c4-9b45-7eb45ef69525 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3/os-volume_attachments/62f30aa9-67ed-4906-87d3-dbd11a814624" status: 202 len: 0 microversion: 2.1 time: 0.331457 Sep 23 03:20:41.006390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 466/927] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:20:40 2021] DELETE /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3/os-volume_attachments/62f30aa9-67ed-4906-87d3-dbd11a814624 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:20:41.634791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:41.635300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:41.642311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:41.642760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:41.643531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:41.643999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:41.766548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:41.774376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:41.775859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:41.777522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-375509df-a637-442a-8265-d9a819cb0e2b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.146071 Sep 23 03:20:41.778068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 462/928] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:41 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:20:42.796219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:42.796934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:42.802999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:42.803440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:42.804232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:42.804700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:42.931163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:42.939005 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:42.940525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:42.941714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d3b70086-ea35-4e57-a2f3-be115ca96dab tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.150070 Sep 23 03:20:42.942271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 467/929] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:42 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:43.176310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:43.176945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:43.182644 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.183643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.184397 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.184852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.208339 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:20:43.549360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ea5e243f-792e-4a87-a88b-343a3d78daed tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 204 len: 0 microversion: 2.1 time: 0.376354 Sep 23 03:20:43.549965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 463/930] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:20:43 2021] DELETE /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:20:43.558068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:43.558688 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:43.564646 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.565094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.565861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.566294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.664212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-a4f2970e-bab8-4e84-8f27-6b842728adfc req-5e4c119b-3c4c-41c4-bb3f-b63b83c4337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "name": "network-vif-plugged", "status": "completed", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:43.666176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:43.666176 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:20:43.673994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-a4f2970e-bab8-4e84-8f27-6b842728adfc req-5e4c119b-3c4c-41c4-bb3f-b63b83c4337b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.676609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-a4f2970e-bab8-4e84-8f27-6b842728adfc req-5e4c119b-3c4c-41c4-bb3f-b63b83c4337b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.685428 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-a4f2970e-bab8-4e84-8f27-6b842728adfc req-5e4c119b-3c4c-41c4-bb3f-b63b83c4337b service nova] Creating event network-vif-plugged:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:20:43.687460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:43.690527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-a4f2970e-bab8-4e84-8f27-6b842728adfc req-5e4c119b-3c4c-41c4-bb3f-b63b83c4337b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Sep 23 03:20:43.691361 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 464/931] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:20:43.695494 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-679f7ffe-cfc5-4284-bc6b-e111ce457984 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1513 microversion: 2.1 time: 0.141029 Sep 23 03:20:43.696130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 468/932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:43 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:43.959985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:43.960927 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:43.968630 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.969089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:43.969870 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:43.970360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:44.096570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:44.104175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:44.105979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:44.107071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-31ef933c-2b4d-4ec8-aaad-8991e71a9445 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.151386 Sep 23 03:20:44.107635 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 465/933] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:43 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:44.711394 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:44.712006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:44.717762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:44.718204 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:44.718984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:44.719415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:44.845994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:44.853391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-dcefbfb1-c458-4f43-8368-a6c8f18f658e tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1513 microversion: 2.1 time: 0.145654 Sep 23 03:20:44.853959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 469/934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:44 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:45.124615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:45.125152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:45.131161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:45.131607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:45.132357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:45.132811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:45.252906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:45.260548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:45.262551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:45.263632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-491325d0-533b-44d0-ad37-9b7c9682a3dd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1408 microversion: 2.20 time: 0.142959 Sep 23 03:20:45.264192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 466/935] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:45 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:45.870228 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:45.870958 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:45.877224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:45.877669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:45.878432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:45.878866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:45.999339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:46.006603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2e04db9b-9db3-4023-91f7-56536629f8f1 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1513 microversion: 2.1 time: 0.140060 Sep 23 03:20:46.007173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 470/936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:45 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:46.281405 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:46.282012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:46.287881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:46.288394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:46.289196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:46.289628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:46.411083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:46.419401 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:46.420908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:46.422035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8f1ddbd8-ea3d-4f87-b8b2-c9f6c3343081 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1600 microversion: 2.20 time: 0.144761 Sep 23 03:20:46.422585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 467/937] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:20:46 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:20:46.442949 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:46.443439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:46.449780 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:46.450220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:46.450979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:46.451410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:46.572900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4a77d523-628d-40ca-88d3-8fb4bfcd93bb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137072 Sep 23 03:20:46.574081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 471/938] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Sep 23 03:20:46 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:20:46.806380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-2780c544-70bd-47e3-abee-1dcf266dce52 req-da91ea3e-e3b4-4add-8368-0fddd5d9a4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecb666b-0d0f-4416-bac8-024b960441f3", "name": "network-vif-deleted", "tag": "83d67bae-4f42-47b4-8a93-967380933503"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:46.808423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:46.808423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:20:46.815178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-2780c544-70bd-47e3-abee-1dcf266dce52 req-da91ea3e-e3b4-4add-8368-0fddd5d9a4a7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:46.815647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-2780c544-70bd-47e3-abee-1dcf266dce52 req-da91ea3e-e3b4-4add-8368-0fddd5d9a4a7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:46.827374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-2780c544-70bd-47e3-abee-1dcf266dce52 req-da91ea3e-e3b4-4add-8368-0fddd5d9a4a7 service nova] Creating event network-vif-deleted:83d67bae-4f42-47b4-8a93-967380933503 for instance aecb666b-0d0f-4416-bac8-024b960441f3 on hv-cinder-76845 Sep 23 03:20:46.832875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-2780c544-70bd-47e3-abee-1dcf266dce52 req-da91ea3e-e3b4-4add-8368-0fddd5d9a4a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029649 Sep 23 03:20:46.834247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 468/939] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:20:47.023189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:47.023814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:47.030313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:47.030756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:47.031517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:47.031954 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:47.092528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:47.105070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-453b63aa-bc56-4e55-b4d9-41421dbbd3a9 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1471 microversion: 2.1 time: 0.080672 Sep 23 03:20:47.105070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 472/940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:47 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1471 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:47.559035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:47.560184 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:47.566446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:47.567097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:47.567974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:47.568521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:47.677401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-60dcc38a-4e7d-4e14-8e68-16092d8e6adb req-cffc3e2c-e2c2-44ab-add4-20effe9402d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:47.679185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:20:47.679185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:20:47.686700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-60dcc38a-4e7d-4e14-8e68-16092d8e6adb req-cffc3e2c-e2c2-44ab-add4-20effe9402d1 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:47.687217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-60dcc38a-4e7d-4e14-8e68-16092d8e6adb req-cffc3e2c-e2c2-44ab-add4-20effe9402d1 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:47.698165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-60dcc38a-4e7d-4e14-8e68-16092d8e6adb req-cffc3e2c-e2c2-44ab-add4-20effe9402d1 service nova] Creating event network-changed:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:20:47.703351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-60dcc38a-4e7d-4e14-8e68-16092d8e6adb req-cffc3e2c-e2c2-44ab-add4-20effe9402d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142620 Sep 23 03:20:47.703946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 473/941] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:20:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:20:48.117834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:48.118678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:48.125672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:48.126177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:48.127173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:48.127688 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:48.187885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:48.195171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-511f33d3-4806-49c3-9dc8-f7b393840e4d tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1471 microversion: 2.1 time: 0.081465 Sep 23 03:20:48.195738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 474/942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:48 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1471 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:49.212100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:49.212761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:49.219051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:49.219491 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:49.220237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:49.220689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:49.288179 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:49.297599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-211fceda-456d-47d2-81bd-67b67e76c339 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1471 microversion: 2.1 time: 0.089079 Sep 23 03:20:49.298180 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 475/943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:49 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1471 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:50.315024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:50.315717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:50.321775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:50.322239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:50.323039 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:50.325743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:50.339684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc7dd04b-17c4-447b-978b-731ca082262d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 2.785118 Sep 23 03:20:50.340702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 469/944] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:47 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:50.407892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db531f61fb2a405baec24793c54c9538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342da2ccebe4ccf9d40607782e2eb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:20:50.415160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f3d72cce-67a7-4773-bec3-d389c395b1bd tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 200 len: 1304 microversion: 2.1 time: 0.103816 Sep 23 03:20:50.415731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 476/945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:50 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:51.351160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:51.352161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:51.359340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:51.359776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:51.360548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:51.361002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:51.431478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:20:51.432087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] [instance: aecb666b-0d0f-4416-bac8-024b960441f3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:51.437194 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f116c599-c45b-4a2e-a176-f019c6674221 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 0.089897 Sep 23 03:20:51.437947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 470/946] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:51 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:20:51.438925 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:51.439371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:51.440136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:51.440590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:51.454748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] HTTP exception thrown: Instance aecb666b-0d0f-4416-bac8-024b960441f3 could not be found. Sep 23 03:20:51.455335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] Returning 404 to user: Instance aecb666b-0d0f-4416-bac8-024b960441f3 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:20:51.456153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5cba41aa-a910-4811-8c90-95887ab9c552 tempest-VolumesSnapshotTestJSON-1739497377 tempest-VolumesSnapshotTestJSON-1739497377-project] 10.222.0.23 "GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3" status: 404 len: 111 microversion: 2.1 time: 0.028522 Sep 23 03:20:51.456718 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 477/947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:20:51 2021] GET /compute/v2.1/servers/aecb666b-0d0f-4416-bac8-024b960441f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:20:52.448604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:52.450089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:52.456714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:52.457162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:52.457933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:52.458360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:52.551679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8851ea12-e4d6-405e-a61a-aee68f2c65bf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 0.107087 Sep 23 03:20:52.552455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 471/948] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:52 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:53.562856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:53.563774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:53.569613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:53.570058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:53.570895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:53.571339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:53.649366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d63bfa7f-1073-40ac-ba17-067ac731fd07 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 0.089992 Sep 23 03:20:53.649917 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 478/949] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:53 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:54.661043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:54.662050 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:54.669142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:54.669968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:54.670336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:54.670771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:57.316949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c24388b6-125a-4f59-9631-5a8d62b6e921 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 2.659649 Sep 23 03:20:57.317585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 472/950] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:54 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:58.328392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:58.329400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:58.335847 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:58.336279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:58.337054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:58.337480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:58.422784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bb3d2284-1dcb-421e-823c-fa5ede5afd06 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 14 microversion: 2.20 time: 0.098288 Sep 23 03:20:58.423571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 479/951] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:58 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:20:59.435008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:20:59.435998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:20:59.442811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:59.443264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:59.444048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:20:59.444482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:20:59.532866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4af40b58-3336-4d94-8098-c1af11f3470b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 4266 microversion: 2.20 time: 0.102251 Sep 23 03:20:59.533490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 473/952] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:20:59 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 4266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:21:00.543792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:00.544803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:00.551254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:00.551690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:00.552440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:00.552885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:00.645017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ba4be03d-f13e-4378-a2c5-f58dbee153f6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 15025 microversion: 2.20 time: 0.105035 Sep 23 03:21:00.649127 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 480/953] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:00 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 15025 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:01.657171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:01.658763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:01.664983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:01.665426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:01.666190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:01.666629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:01.777097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-777999b4-e611-4216-ad92-ca2a427176f7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 18608 microversion: 2.20 time: 0.123050 Sep 23 03:21:01.785101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 474/954] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:01 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 18608 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:02.788864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:02.789851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:02.796474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:02.796938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:02.797691 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:02.798117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:02.907354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-13bcf164-9716-4dc3-aba7-8e6ffbe3410a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 19539 microversion: 2.20 time: 0.122355 Sep 23 03:21:02.908009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 481/955] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:02 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 19539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:03.919191 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:03.920188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:03.928548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:03.929011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:03.929787 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:03.930223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:04.020800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-183571e7-d43b-4a2d-98d3-6948359ad830 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 22546 microversion: 2.20 time: 0.105474 Sep 23 03:21:04.021451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 475/956] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:03 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 22546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:05.033820 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:05.034816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:05.041254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:05.041758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:05.042516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:05.042946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:07.429731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ec0ef43a-8056-4ef3-b482-6009b801dd9c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 26714 microversion: 2.20 time: 2.399862 Sep 23 03:21:07.430402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 482/957] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:05 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 26714 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:08.442442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:08.443425 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:08.450450 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:08.450888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:08.451646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:08.452075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:08.546212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5ce5fa96-cb20-4e7b-be62-d5992e3328ee tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 27484 microversion: 2.20 time: 0.107672 Sep 23 03:21:08.550039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 476/958] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:08 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 27484 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:09.558884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:09.559883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:09.566353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:09.566797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:09.567556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:09.567985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:09.658408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-18679445-6677-4490-aba2-541193901b72 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 27784 microversion: 2.20 time: 0.104100 Sep 23 03:21:09.659027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 483/959] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:09 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 27784 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:10.670599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:10.671699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:10.678121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:10.678558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:10.679311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:10.679730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:10.786026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fd76f041-4d3b-4835-b007-21a8e91ea730 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 27962 microversion: 2.20 time: 0.119969 Sep 23 03:21:10.786643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 477/960] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:10 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 27962 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:11.798038 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:11.799090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:11.806051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:11.806215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:11.806948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:11.807382 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:11.900206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d82caca3-624f-4e89-8a19-91ea22aeb01a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28029 microversion: 2.20 time: 0.105991 Sep 23 03:21:11.900823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 484/961] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:11 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28029 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:12.912096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:12.913137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:12.920047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:12.920550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:12.921263 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:12.921696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:13.003211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d72ca672-4cf4-4e58-a14e-8ff77c5cd0cd tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28029 microversion: 2.20 time: 0.094995 Sep 23 03:21:13.003859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 478/962] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:12 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28029 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:14.015670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:14.016684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:14.023073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:14.023547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:14.024334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:14.024782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:14.120865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2b61ca51-4f59-4c74-86ff-97cfa3d0e9af tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.109011 Sep 23 03:21:14.121523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 485/963] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:14 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:15.133080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:15.134069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:15.140528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:15.140977 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:15.141729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:15.142159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:15.246140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ff1d47cb-6157-4d12-b7d4-dc47f10eb815 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.116940 Sep 23 03:21:15.251106 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 479/964] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:15 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:16.261404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:16.262326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:16.271360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:16.271804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:16.272651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:16.273083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:16.358683 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fd3ee88f-4e68-4e9f-9313-b8541cfea46c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.101316 Sep 23 03:21:16.359303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 486/965] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:16 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:17.371255 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:17.372278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:17.378656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:17.379097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:17.379915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:17.380340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:17.468565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-904046ff-9bcd-4521-9d06-0277ab70909c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.101783 Sep 23 03:21:17.469178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 480/966] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:17 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:18.480069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:18.481063 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:18.487468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:18.487911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:18.488702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:18.489136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:18.573317 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-19f7fb2d-d867-4624-bbff-70ae6eb084f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.096903 Sep 23 03:21:18.573954 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 487/967] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:18 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:19.585842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:19.586885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:19.593808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:19.594260 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:19.595162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:19.595600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:19.694351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-519dc2e1-fbe3-4c5d-b5b4-5d93142c9ccb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.112458 Sep 23 03:21:19.698973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 481/968] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:19 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:20.707193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:20.708187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:20.714666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:20.715105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:20.715861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:20.716292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:20.797971 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1071c33f-1901-4456-a659-6130692f0126 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.094680 Sep 23 03:21:20.799096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 488/969] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:20 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:21.810733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:21.811721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:21.818193 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:21.818638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:21.819415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:21.819847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:21.904864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-17316982-14be-4fdc-914b-490fed720dc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.097825 Sep 23 03:21:21.905761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 482/970] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:21 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:22.916959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:22.917972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:22.924613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:22.925050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:22.925897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:22.926216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:23.014937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-30bed312-587b-46dd-ba8e-33d14fea59ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.101783 Sep 23 03:21:23.015685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 489/971] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:22 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:21:24.033656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:24.035322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:24.044815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:24.045524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:24.046454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:24.046890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:24.140028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-159d5e40-562c-4348-8ef6-1c54ea795e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.116996 Sep 23 03:21:24.140708 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 483/972] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:24 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:25.152079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:25.153122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:25.160006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:25.160461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:25.161354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:25.161785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:25.265923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2e42a693-b9f8-475a-8521-d2065a45d784 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28146 microversion: 2.20 time: 0.118021 Sep 23 03:21:25.266659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 490/973] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:25 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28146 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:26.278172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:26.279376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:26.286723 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:26.287276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:26.292578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:26.293310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:26.403560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c77ec354-34bb-4954-b0d2-9001375f06cc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28271 microversion: 2.20 time: 0.129264 Sep 23 03:21:26.407700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 484/974] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:26 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:27.416360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:27.417741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:27.423770 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:27.424209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:27.425250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:27.425880 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:27.530444 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a672ccc0-42a9-499f-9de9-0fdf05c569dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28437 microversion: 2.20 time: 0.118533 Sep 23 03:21:27.531112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 491/975] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:27 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:28.550947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:28.552970 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:28.560121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:28.560692 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:28.561539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:28.562037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:28.656747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-76a7e072-843e-4671-afa8-b891fc1c7d76 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.109886 Sep 23 03:21:28.657744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 485/976] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:28 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:29.676705 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:29.678526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:29.692714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:29.696148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:29.698061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:29.698724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:29.807763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-654084ab-5b2d-4bdc-984f-f4d05ee9f786 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.140742 Sep 23 03:21:29.812048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 492/977] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:29 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:30.820100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:30.821479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:30.829231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:30.829713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:30.830696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:30.831220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:30.935029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1cb91411-1528-4d7b-a11b-0ed9b483430e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.115456 Sep 23 03:21:30.936521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 486/978] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:30 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:31.953447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:31.955068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:31.966960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:31.967686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:31.968724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:31.969157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:32.054658 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-80b9dd07-2434-4e86-b77f-55e5bad10bc8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.105153 Sep 23 03:21:32.056064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 493/979] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:31 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:33.068448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:33.069959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:33.080424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:33.081180 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:33.082133 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:33.083382 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:33.172981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-05444689-3ecb-4916-bb75-414e015db811 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.109123 Sep 23 03:21:33.173638 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 487/980] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:33 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:33.520286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Action: 'create', calling method: .version_select at 0x7fd1b418a940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1629492020"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:33.538570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:21:33.543725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for user e083df39fb8c475ab468e84c6134c764 and project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:21:33.728423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:21:33.734796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for user e083df39fb8c475ab468e84c6134c764 and project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:21:33.748523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ac3f885b-b7cd-433b-bc26-a138df088ab9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.398836 Sep 23 03:21:33.749145 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 494/981] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Sep 23 03:21:33 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:21:34.185591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:34.186580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:34.193032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:34.193470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:34.194227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:34.194660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:34.284835 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f74d31fc-987c-456d-93f6-0023842be8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.103224 Sep 23 03:21:34.285721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 488/982] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:34 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:35.305677 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:35.307858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:35.314733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:35.315225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:35.316170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:35.316844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:35.398220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c7a6b21c-644c-41f5-870d-6395d8860ee3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.097740 Sep 23 03:21:35.402621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 495/983] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:35 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:36.410938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:36.412051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:36.419187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:36.419712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:36.420641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:36.421094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:36.504553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-22accbd4-d156-476b-bdd1-134ddb458dd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.097860 Sep 23 03:21:36.505351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 489/984] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:36 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:37.517325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:37.518323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:37.524763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:37.525260 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:37.526021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:37.526446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:37.621515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-dbfbfc39-e779-492f-81c5-d218d46b50ef tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.107956 Sep 23 03:21:37.622081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 496/985] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:37 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:38.633558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:38.635046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:38.641473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:38.641917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:38.642670 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:38.643098 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:38.739485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d4d4febc-d847-484a-b85e-f40bf99cbd0a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.109771 Sep 23 03:21:38.741298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 490/986] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:38 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:39.751997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:39.752934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:39.760023 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:39.760539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:39.761328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:39.761763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:39.845206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2b0761c1-d69a-4603-adc6-1ea0537437d4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.097255 Sep 23 03:21:39.845852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 497/987] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:39 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:40.858076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:40.859062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:40.865456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:40.865898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:40.866651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:40.867078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:40.957154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-50d75b75-3055-4df4-99e0-4789896f311f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.103668 Sep 23 03:21:40.957721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 491/988] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:40 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:41.969500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:41.970493 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:41.976905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:41.977356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:41.978114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:41.978550 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:42.067836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d8b7feb2-0a35-491e-9925-3e5e0834a6e6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.102191 Sep 23 03:21:42.068618 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 498/989] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:41 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:43.079973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:43.081582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:43.087675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:43.088350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:43.089661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:43.090155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:43.189464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b72f6a83-2d27-4507-8ec3-70272a0376f4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.113322 Sep 23 03:21:43.190121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 492/990] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:43 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:44.201042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:44.201947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:44.208384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:44.208864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:44.209629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:44.210062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:44.309453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-39c3de5e-e87d-482f-b638-efbd4cc0967f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.112508 Sep 23 03:21:44.310106 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 499/991] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:44 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:45.322310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:45.323301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:45.329732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:45.330173 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:45.330928 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:45.331353 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:45.414706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2a09414c-b58d-40df-b746-cd039cf553f5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.096811 Sep 23 03:21:45.415833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 493/992] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:45 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:46.426689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:46.437542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:46.437542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:46.437542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:46.437542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:46.438166 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:46.520262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e5e8fa95-c40e-43fe-ae88-17e00650ab4d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.097465 Sep 23 03:21:46.521150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 500/993] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:46 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:21:47.532226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:47.533235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:47.539601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:47.540038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:47.540846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:47.541269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:47.623725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4c054f34-0048-4d2b-9ee2-e7723d586d71 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.095426 Sep 23 03:21:47.624367 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 494/994] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:47 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:48.636332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:48.637356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:48.643656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:48.644089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:48.644867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:48.645288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:48.744282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bfecc50c-4e19-4be7-a096-6ebc57cc4d96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.111929 Sep 23 03:21:48.744996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 501/995] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:48 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:49.756381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:49.757393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:49.764315 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:49.764786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:49.765544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:49.765973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:49.847402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-13e3fdb1-5695-4033-98cd-8ef45dc7d735 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.094938 Sep 23 03:21:49.848040 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 495/996] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:49 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:50.859666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:50.860716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:50.867199 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:50.867581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:50.868859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:50.869292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:50.962141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-eea3240b-3107-44f4-8a4f-c4ee49462396 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.106459 Sep 23 03:21:50.962742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 502/997] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:50 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:21:51.974249 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:51.975245 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:51.982574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:51.983014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:51.983761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:51.984186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:52.069421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-635a5e58-33e7-4907-8ae3-0063e8747548 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.099214 Sep 23 03:21:52.070020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 496/998] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:51 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:53.082295 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:53.083288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:53.090258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:53.090700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:53.091463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:53.091894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:53.174534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b779651b-e0f0-4a22-9874-17017ede8a56 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.096227 Sep 23 03:21:53.175414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 503/999] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:53 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:21:54.187131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:54.188105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:54.194523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:54.194957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:54.195735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:54.196157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:54.284021 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5411da0c-0eac-4c72-aaa4-4af04f2aa270 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.100743 Sep 23 03:21:54.284711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 497/1000] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:54 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:55.296576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:55.297593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:55.304187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:55.304742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:55.305509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:55.306510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:55.393605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f5f53366-4a8f-4a3c-a049-c12fdc798073 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.100859 Sep 23 03:21:55.394245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 504/1001] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:55 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:56.406137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:56.407118 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:56.413472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:56.413909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:56.414662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:56.415172 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:56.499926 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-13d86a11-2d4d-4691-9792-dc73891099d6 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.097816 Sep 23 03:21:56.500562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 498/1002] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:56 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:57.511891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:57.512908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:57.519348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:57.519785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:57.520559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:57.520985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:57.601151 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6b4e5087-d5e5-46f6-bd13-9c854f80ad16 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.093153 Sep 23 03:21:57.601752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 505/1003] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:57 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:58.614134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:58.619867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:58.621941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:58.622421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:58.623217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:58.623651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:58.702619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c55dd42d-2400-4e86-9a67-10b37a34ebd5 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.092365 Sep 23 03:21:58.703323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 499/1004] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:58 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:21:59.715391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:21:59.716381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:21:59.723048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:59.723536 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:59.724297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:21:59.724762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:21:59.810013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a8860480-b316-4000-9d54-079fb1771be4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.099134 Sep 23 03:21:59.812947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 506/1005] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:21:59 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:00.119210 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1277752826", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1629492020", "security_groups": [{"name": "tempest-secgroup-smoke-1540755271"}], "networks": [{"uuid": "256ff840-637a-4fa9-91bf-bd69e4407d67"}], "block_device_mapping_v2": [{"uuid": "32868128-500c-4939-b28d-95a007059fc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:00.230942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] validate_networks() for [('256ff840-637a-4fa9-91bf-bd69e4407d67', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:22:00.585174 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:22:00.585535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:22:00.586001 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:22:00.586429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:22:00.587395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:22:00.596101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:00.596575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:00.597366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:00.597819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:00.614180 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:22:00.618037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Getting quotas for user e083df39fb8c475ab468e84c6134c764 and project 6c9295094fe94cc69e88db5d29658b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:22:00.678414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:22:00.678820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32868128-500c-4939-b28d-95a007059fc0',volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:22:00.823009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:00.824026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:00.830784 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:00.836709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:00.836709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:00.836709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:00.917836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4eefd3a6-6734-459d-b49b-531d0905a4b8 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.099410 Sep 23 03:22:00.918466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 507/1006] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:00 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:22:01.073942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [784d4fa4-4235-4bc7-9d67-8fecd0277ecf] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:22:01.930059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:01.931045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:01.937405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:01.937845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:01.938585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:01.939010 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:02.032967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c7d61426-846a-4108-a11e-9089338ea8cf tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 28605 microversion: 2.20 time: 0.106831 Sep 23 03:22:02.033613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 508/1007] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:01 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 28605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:22:02.090446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [784d4fa4-4235-4bc7-9d67-8fecd0277ecf] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34416. Sep 23 03:22:02.094262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3946ad6a-be57-4ab4-b151-ff8a717be95b tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.979965 Sep 23 03:22:02.094892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 500/1008] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:22:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:22:02.105176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-276629e7-2c68-490b-a93d-e417c3f45137 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:02.105867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-276629e7-2c68-490b-a93d-e417c3f45137 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:02.158791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-276629e7-2c68-490b-a93d-e417c3f45137 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:02.165379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-276629e7-2c68-490b-a93d-e417c3f45137 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1089 microversion: 2.1 time: 0.064506 Sep 23 03:22:02.165940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 509/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:02 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:03.045063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:03.046073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:03.053085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:03.053565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:03.054324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:03.054749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:03.156022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b760030a-1afa-4e24-b0ef-59cbbe4de361 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 29372 microversion: 2.20 time: 0.114478 Sep 23 03:22:03.156778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 501/1010] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:03 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 29372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:03.181934 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a5fafca0-9fc3-4334-9af4-afb830a400f2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:03.182625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a5fafca0-9fc3-4334-9af4-afb830a400f2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:03.237719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a5fafca0-9fc3-4334-9af4-afb830a400f2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:03.245765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a5fafca0-9fc3-4334-9af4-afb830a400f2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1089 microversion: 2.1 time: 0.067467 Sep 23 03:22:03.246404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 510/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:03 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:04.168771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:04.169736 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:04.176212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:04.176696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:04.177459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:04.177957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:04.261874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-700ada7d-53a9-46e6-a394-7f7972f870c9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:04.262485 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-700ada7d-53a9-46e6-a394-7f7972f870c9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:04.268370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e3b66fea-0768-4be3-b827-5ee075f753e3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 31696 microversion: 2.20 time: 0.104175 Sep 23 03:22:04.269254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 502/1012] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:04 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 31696 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:04.312683 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-700ada7d-53a9-46e6-a394-7f7972f870c9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:04.319030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-700ada7d-53a9-46e6-a394-7f7972f870c9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1089 microversion: 2.1 time: 0.060755 Sep 23 03:22:04.319585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:04 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1089 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:22:05.279773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:05.280785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:05.287058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:05.287500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:05.288246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:05.288703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:05.335081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:05.335719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:05.342206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:05.342641 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:05.343391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:05.343817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:05.386132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5a19848c-4f6a-408c-ab5c-6012df27f81a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 33309 microversion: 2.20 time: 0.110222 Sep 23 03:22:05.386897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 503/1014] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:05 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 33309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:05.403846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:05.411118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0c4a0261-5f73-4195-90b1-d91c352340d9 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1131 microversion: 2.1 time: 0.079639 Sep 23 03:22:05.411679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 512/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:05 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1131 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:22:06.398833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:06.400389 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:06.406902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:06.414165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:06.414165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:06.414165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:06.426956 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:06.427561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:06.434203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:06.434647 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:06.435404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:06.435936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:06.497731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:06.505045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5f8e4bbf-a8aa-4efb-81aa-85f8287786ab tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1195 microversion: 2.1 time: 0.081862 Sep 23 03:22:06.505601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 513/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:06 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1195 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:22:06.519770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-48169544-41fa-4e8b-bf5c-d7bbdf0b343e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 34322 microversion: 2.20 time: 0.125076 Sep 23 03:22:06.520684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 504/1017] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:06 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 34322 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:07.525651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:07.532119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:07.533144 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:07.539600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:07.542632 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:07.546729 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:07.547182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:07.549022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:07.550064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:07.550507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:07.553279 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:07.553726 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:07.657059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e5f3dc2f-402f-4f15-9468-58d33e88f80d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 35442 microversion: 2.20 time: 0.129053 Sep 23 03:22:07.663406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 505/1018] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:07 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 35442 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:07.779442 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:07.786703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-74de64b2-b75c-4f2d-8fc9-13132269ca9a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1273 microversion: 2.1 time: 0.265520 Sep 23 03:22:07.787280 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 514/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:07 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:08.392941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-58d1df88-dba3-4d5c-a350-8050783cf539 req-cd76c43a-70fc-44c4-9004-9e9ef274d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:08.394102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:22:08.394102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:22:08.402167 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-58d1df88-dba3-4d5c-a350-8050783cf539 req-cd76c43a-70fc-44c4-9004-9e9ef274d9bf service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:08.408204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-58d1df88-dba3-4d5c-a350-8050783cf539 req-cd76c43a-70fc-44c4-9004-9e9ef274d9bf service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:08.413895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-58d1df88-dba3-4d5c-a350-8050783cf539 req-cd76c43a-70fc-44c4-9004-9e9ef274d9bf service nova] Creating event network-changed:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:22:08.420072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-58d1df88-dba3-4d5c-a350-8050783cf539 req-cd76c43a-70fc-44c4-9004-9e9ef274d9bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031395 Sep 23 03:22:08.420701 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 506/1020] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:22:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:22:08.675047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:08.679525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:08.681894 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:08.682336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:08.683096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:08.683527 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:08.797054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c1b08fb8-9903-4e16-8590-82852e2c179d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 36932 microversion: 2.20 time: 0.125523 Sep 23 03:22:08.798114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 515/1021] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:08 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 36932 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:08.805368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:08.806061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:08.812086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:08.812560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:08.813399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:08.813844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:08.936082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:08.943286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-539b3d7d-24be-4693-a07e-f72d078a5c6a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.142836 Sep 23 03:22:08.943852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 507/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:08 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:22:09.808681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:09.809733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:09.816228 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:09.816733 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:09.817497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:09.817926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:09.919329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-614a69f3-7047-4b87-a061-db6abe48a8b9 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 38164 microversion: 2.20 time: 0.114586 Sep 23 03:22:09.919960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 516/1023] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:09 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 38164 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:09.960167 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:09.960863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:09.967013 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:09.967452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:09.968199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:09.968663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:10.088600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:10.095651 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c57a55cb-c516-4be8-842b-0376dcef0f29 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.139080 Sep 23 03:22:10.096199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 508/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:09 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:10.932283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:10.933298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:10.939644 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:10.940082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:10.940860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:10.941286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:11.026123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c9f3076b-d85e-4fbf-bb15-9d1dc1c3ee7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 38164 microversion: 2.20 time: 0.098226 Sep 23 03:22:11.026670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 517/1025] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:10 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 38164 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:22:11.112422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:11.113115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:11.119482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:11.119930 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:11.120717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:11.121147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:11.236165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:11.243763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bfe7a5d2-383e-4f07-8e64-ecc68a1ed939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.134972 Sep 23 03:22:11.244325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 509/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:11 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:12.038680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:12.039702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:12.046192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:12.046634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:12.047391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:12.047819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:12.134211 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-26ca05b2-96e5-4521-abb2-df01229b5475 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 38164 microversion: 2.20 time: 0.099389 Sep 23 03:22:12.134762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 518/1027] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:12 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 38164 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:22:12.261340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:12.261948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:12.268215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:12.268686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:12.269437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:12.269909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:12.387459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:12.394654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-56ce28fc-5ad1-4873-993a-ca905b57e9b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.137872 Sep 23 03:22:12.395211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 510/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:12 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:13.146813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:13.147810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:13.154859 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:13.155291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:13.156037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:13.156461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:13.239109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c993de7d-4f11-4b73-a65b-25d2fd93da12 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 38164 microversion: 2.20 time: 0.096466 Sep 23 03:22:13.239744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 519/1029] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:13 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 38164 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:22:13.411251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:13.411787 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:13.418179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:13.418618 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:13.419441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:13.419874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:13.539036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:13.547071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-13ba8dce-338d-40fa-847f-05cea0bb87d5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.139452 Sep 23 03:22:13.547619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 511/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:13 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:14.251957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:14.252882 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:14.260164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.260638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.261436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.261871 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.352978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9da80a97-6242-421e-b1c1-0a163e40d7df tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 200 len: 38307 microversion: 2.20 time: 0.104878 Sep 23 03:22:14.353896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 520/1031] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:14 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 38307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:22:14.363590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:14.364070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:14.370712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.371156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.371908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.372335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.395284 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e0171809-f85f-43ca-a76f-14af70e615a3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/ips" status: 200 len: 152 microversion: 2.20 time: 0.035364 Sep 23 03:22:14.395823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 512/1032] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Sep 23 03:22:14 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:22:14.564282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:14.565025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:14.572000 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.572468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.573244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:14.573674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:14.696205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:14.703624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1c241d12-e992-4968-ac18-825e63d56c55 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.143373 Sep 23 03:22:14.704189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 521/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:14 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:15.720627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:15.721257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:15.727077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:15.727551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:15.728304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:15.729007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:15.845684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:15.852854 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34c0407f-38fe-466b-a3fc-542875d2f3bd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.135872 Sep 23 03:22:15.853660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 513/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:15 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:16.869064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:16.869671 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:16.875890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:16.876329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:16.877120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:16.877547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:16.996351 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:17.003700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b2828736-a18d-4085-9e30-4699bfa04ff2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.138638 Sep 23 03:22:17.004257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 522/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:16 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:17.044609 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:17.045265 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:17.051627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:17.052065 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:17.052892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:17.057813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:17.075770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lazy-loading 'flavor' on Instance uuid f07f014b-f5d0-4005-b467-e11414c5176f {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:22:17.679225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d85eaa1f-fab9-410c-a413-2f36477ece96 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 202 len: 0 microversion: 2.20 time: 0.638168 Sep 23 03:22:17.683981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 514/1036] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:17 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:22:17.689526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:17.690423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:17.696463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:17.696955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:17.697732 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:17.698165 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:17.833224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:17.842276 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:17.844354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:17.845559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-72b939b4-eed3-4819-bea5-8ff4a2980709 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.160090 Sep 23 03:22:17.846316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 523/1037] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:17 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:18.021081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:18.021705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:18.027800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:18.028241 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:18.029024 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:18.029457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:18.149257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:18.156398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4c0b62d1-bc44-4511-8067-8e6aeca99f01 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.139383 Sep 23 03:22:18.156983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 515/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:18 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:18.864778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:18.865384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:18.871689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:18.872129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:18.872914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:18.873344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:18.994049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:19.001556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:19.003029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:19.004162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-eb93b29c-5ba5-4c06-a33a-5b6f25c06599 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.143387 Sep 23 03:22:19.004742 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 524/1039] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:18 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:19.172667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:19.173381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:19.179557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:19.180594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:19.181369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:19.181800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:19.306343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:19.313601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d37f911a-378e-496a-8b1a-27c037aaa084 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.144682 Sep 23 03:22:19.322975 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 516/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:19 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:19.801034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-e2134d4f-7894-456b-abcc-faab14412293 req-e26746e3-095d-46e0-861e-710fa8ed510f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "name": "network-vif-plugged", "status": "completed", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:19.802578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:22:19.802578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:22:19.809946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e2134d4f-7894-456b-abcc-faab14412293 req-e26746e3-095d-46e0-861e-710fa8ed510f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:19.810372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-e2134d4f-7894-456b-abcc-faab14412293 req-e26746e3-095d-46e0-861e-710fa8ed510f service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:19.821244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-e2134d4f-7894-456b-abcc-faab14412293 req-e26746e3-095d-46e0-861e-710fa8ed510f service nova] Creating event network-vif-plugged:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:22:19.825969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-e2134d4f-7894-456b-abcc-faab14412293 req-e26746e3-095d-46e0-861e-710fa8ed510f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028607 Sep 23 03:22:19.826544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 525/1041] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:22:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:22:20.022147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:20.022756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:20.028413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:20.028889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:20.029658 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:20.030125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:20.150251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:20.158113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:20.159591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:20.164082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-519bf705-0c7b-4cb8-9c28-97436c5cc48a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.142414 Sep 23 03:22:20.164082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 517/1042] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:20 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:20.330457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:20.331155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:20.337618 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:20.338056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:20.338809 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:20.339233 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:20.455182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:20.462869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fbba50aa-0ca7-4161-8db8-e83d84ce052e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.136472 Sep 23 03:22:20.463427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 526/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:20 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:21.179017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:21.179617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:21.185978 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:21.186440 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:21.187180 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:21.187606 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:21.302883 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:21.310671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:21.312140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:21.313302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3acd90de-b0b7-42a9-9336-eaf61754cf6c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.138115 Sep 23 03:22:21.313862 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 518/1044] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:21 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:21.479210 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:21.479751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:21.485660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:21.486103 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:21.486861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:21.487287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:21.609168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:21.616391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6c342566-9611-41b5-942f-3aef072ed326 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1261 microversion: 2.1 time: 0.141166 Sep 23 03:22:21.616983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 527/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:21 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:22.331551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:22.332145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:22.338704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.339143 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.339889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.340316 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.468733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:22.476846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:22.478582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:22.479717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e6885e82-f98e-420a-94f1-504d5245749f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.151923 Sep 23 03:22:22.480268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 519/1046] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:22 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:22.632009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:22.632574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:22.638370 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.638810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.639564 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.640037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.775266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:22.782509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e38b6c31-1705-44cb-a09c-c822e63e1b2f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1445 microversion: 2.1 time: 0.154128 Sep 23 03:22:22.783078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 528/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:22 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:22.798505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:22.799117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:22.807344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.807820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.809049 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:22.809622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:22.927916 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:22.935672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2a19864f-1df6-4f91-9e4b-0cf7fa19a5c2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1445 microversion: 2.1 time: 0.140814 Sep 23 03:22:22.936237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 520/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:22:22 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1445 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:22:23.498634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:23.499672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:23.507274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:23.508235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:23.509043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:23.509473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:23.728158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:23.736230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:23.737762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:23.738907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-89799e1f-75a9-4cf1-9d96-65225165aa7c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.245098 Sep 23 03:22:23.739459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 529/1049] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:23 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:24.756305 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:24.756934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:24.763266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:24.763713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:24.764479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:24.764934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:24.889646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:24.897374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:24.899427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:24.900594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-65ec8292-f7d6-4c20-881c-c5c06e24d06a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.147937 Sep 23 03:22:24.901151 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 521/1050] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:24 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:25.425833 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-909d6d50-c938-418b-9afb-0b52d8b71975 req-651f0ee8-fa97-4dcd-945f-ac724000ed13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:25.427321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:22:25.427321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:22:25.434548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-909d6d50-c938-418b-9afb-0b52d8b71975 req-651f0ee8-fa97-4dcd-945f-ac724000ed13 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:25.435597 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-909d6d50-c938-418b-9afb-0b52d8b71975 req-651f0ee8-fa97-4dcd-945f-ac724000ed13 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:25.445869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-909d6d50-c938-418b-9afb-0b52d8b71975 req-651f0ee8-fa97-4dcd-945f-ac724000ed13 service nova] Creating event network-changed:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:22:25.450763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-909d6d50-c938-418b-9afb-0b52d8b71975 req-651f0ee8-fa97-4dcd-945f-ac724000ed13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029505 Sep 23 03:22:25.451634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 530/1051] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:22:25.918823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:25.919422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:25.925985 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:25.926421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:25.927190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:25.927616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:26.058625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:26.066828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:26.068298 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:26.069462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fa3fc63c-aabe-4521-9993-e1866af8aec1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.154598 Sep 23 03:22:26.070016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 522/1052] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:25 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:27.088524 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:27.089191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:27.095241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:27.095683 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:27.096436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:27.096884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:27.217787 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:27.225787 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:27.227763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:27.229193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2dfd8c01-31dd-407a-89b4-ff4b5b640db0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.145045 Sep 23 03:22:27.229745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 531/1053] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:27 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:28.247003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:28.247534 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:28.253351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:28.253790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:28.254535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:28.254960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:28.372756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:28.380204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:28.381713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:28.383408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a83abcf1-a54d-486b-be7f-1d9e4f30f119 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.139609 Sep 23 03:22:28.383960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 523/1054] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:28 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:29.401077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:29.401676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:29.407460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:29.407890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:29.408665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:29.409089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:29.531504 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:29.539603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:29.541135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:29.542274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-173fbea0-1a55-4b52-939e-41c91b1ed0f0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1746 microversion: 2.20 time: 0.144933 Sep 23 03:22:29.542823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 532/1055] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:29 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1746 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:30.560268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:30.560913 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:30.566746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:30.567188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:30.567935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:30.568364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:30.684880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:30.692469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:30.694053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:30.695745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-88da2b95-581e-41ad-b59f-1c81e6475fa2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1746 microversion: 2.20 time: 0.138707 Sep 23 03:22:30.696300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 524/1056] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:30 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1746 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:31.714253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:31.714985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:31.725624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:31.725624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:31.725624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:31.725624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:31.850251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:31.858365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:31.859856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:31.861020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c3a9f67a-231b-4fab-8d3a-763cad45876a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1746 microversion: 2.20 time: 0.151040 Sep 23 03:22:31.861566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 533/1057] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:31 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:32.878767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:32.879372 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:32.885416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:32.885891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:32.886682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:32.887110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:33.006914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:33.014498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:33.015979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:33.017181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0c36d643-67c2-47ae-872d-02d3ab99006e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1746 microversion: 2.20 time: 0.142129 Sep 23 03:22:33.017733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 525/1058] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:32 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1746 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:33.837867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-84d4d2c7-901d-4c6f-a6a1-8ba582887f64 req-99f97343-b8a6-44f5-8090-ab95782e4991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "name": "network-vif-plugged", "status": "completed", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:33.839405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:22:33.839405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:22:33.846044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-84d4d2c7-901d-4c6f-a6a1-8ba582887f64 req-99f97343-b8a6-44f5-8090-ab95782e4991 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:33.846478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-84d4d2c7-901d-4c6f-a6a1-8ba582887f64 req-99f97343-b8a6-44f5-8090-ab95782e4991 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:33.857463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-84d4d2c7-901d-4c6f-a6a1-8ba582887f64 req-99f97343-b8a6-44f5-8090-ab95782e4991 service nova] Creating event network-vif-plugged:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:22:33.862562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-84d4d2c7-901d-4c6f-a6a1-8ba582887f64 req-99f97343-b8a6-44f5-8090-ab95782e4991 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028334 Sep 23 03:22:33.863123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 534/1059] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:22:34.035372 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:34.036072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:34.042649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:34.043041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:34.043792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:34.044218 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:34.159959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:34.168400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:34.169954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:34.171091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c34424b3-5105-498a-baf6-f17389b762dc tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1746 microversion: 2.20 time: 0.139475 Sep 23 03:22:34.171641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 526/1060] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:34 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1746 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:35.189694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:35.190373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:35.196558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:35.197008 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:35.197808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:35.198237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:35.318854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:35.326582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:35.328069 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:35.329298 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a4d84a2f-a32f-4ecd-8a81-be2e43415a60 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.143597 Sep 23 03:22:35.329860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 535/1061] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:35 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:36.347010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:36.347902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:36.354262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:36.355011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:36.355982 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:36.356625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:36.488434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:36.499077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:36.500995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:36.502140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce15039f-75ad-4109-9808-ac12376496d1 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.158840 Sep 23 03:22:36.502693 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 527/1062] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:36 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:37.522237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:37.523566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:37.529610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:37.530050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:37.530818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:37.531244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:37.659903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:37.669117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:37.671079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:37.672761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fdc32f17-1bac-4e7b-983d-77779e17478a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.154203 Sep 23 03:22:37.673836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 536/1063] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:37 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:22:38.703373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:38.704620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:38.711243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:38.711728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:38.712766 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:38.713473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:38.854350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:38.862866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:38.864939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:38.866206 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4ffd67fb-c7b5-4f77-abe4-c66467ae2fad tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.169366 Sep 23 03:22:38.868707 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 528/1064] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:38 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:39.885530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:39.886131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:39.893142 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:39.893863 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:39.894866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:39.895305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:40.022354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:40.031168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:40.033808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:40.034661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f125a25f-d1a0-4a30-84d8-42d02f896dcb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.153368 Sep 23 03:22:40.045470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 537/1065] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:39 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:22:41.052967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:41.054937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:41.061745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:41.062192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:41.062962 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:41.063393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:41.212523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:41.221170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:41.222802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:41.224097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1547b6e8-825d-48dd-b749-e5cda3585c39 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.175315 Sep 23 03:22:41.224795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 529/1066] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:41 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:42.243753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:42.244410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:42.251379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:42.251821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:42.252611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:42.253041 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:42.404736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:42.414632 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:42.416143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:42.421045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2cfda0e0-a8d8-4b67-8927-56f3fe1f4e13 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.177597 Sep 23 03:22:42.423679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 538/1067] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:42 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:43.441105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:43.441849 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:43.448864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:43.449313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:43.450177 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:43.450619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:43.581047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:43.589580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:43.591067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:43.592240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-74c84704-c63c-4f26-9071-844be6ef0c1a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.154882 Sep 23 03:22:43.604161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 530/1068] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:43 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:44.610548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:44.611164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:44.618111 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:44.618624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:44.619424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:44.619858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:44.764180 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:44.771997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:44.773535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:44.774672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2524123f-7e03-480c-bfcd-05deb7a9efa4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.168004 Sep 23 03:22:44.775240 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 539/1069] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:44 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:45.792632 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:45.793230 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:45.798968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:45.799402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:45.800146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:45.800601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:45.924247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:45.932363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:45.933857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:45.934982 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9636e4da-02aa-4441-b35b-72ecfd407e26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.146043 Sep 23 03:22:45.935528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 531/1070] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:45 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:46.952869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:46.953468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:46.959182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:46.959621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:46.961055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:46.961483 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:47.079417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:47.087793 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:47.089322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:47.090462 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ea9bb25c-d46b-4b71-891a-66b82f670fc3 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1741 microversion: 2.20 time: 0.141289 Sep 23 03:22:47.091017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 540/1071] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:46 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1741 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:48.108650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:48.109194 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:48.114995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:48.115437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:48.116739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:48.117139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:48.234254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:48.242328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:48.243809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:48.245039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5a650e37-1b77-4d79-a8ab-0c4743d0d741 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1723 microversion: 2.20 time: 0.140314 Sep 23 03:22:48.245594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 532/1072] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:48 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:49.262976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:49.263570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:49.269765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:49.270197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:49.270943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:49.271366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:49.388047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:49.395604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:49.397116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:49.398748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-250410da-e21b-4878-9fa6-1764aa950e36 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1723 microversion: 2.20 time: 0.139523 Sep 23 03:22:49.399303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 541/1073] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:49 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:50.416808 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:50.417354 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:50.422988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:50.423424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:50.424171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:50.424621 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:50.543415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:50.550995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:50.552462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:50.553607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6f0f9297-a56c-4fd6-9733-25bd342e1b5f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1726 microversion: 2.20 time: 0.141156 Sep 23 03:22:50.554706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 533/1074] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:50 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1726 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:50.571109 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7218aa0e-89e2-4193-8746-486a2424acaa"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:50.572143 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:50.577895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:50.578332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:50.579079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:50.579501 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:51.622414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5ccf71e0-3c16-4fd5-9c64-0e0845f90341 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.054862 Sep 23 03:22:51.623047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 542/1075] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Sep 23 03:22:50 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments => generated 188 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:22:51.743148 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:51.743656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:51.749370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:51.749811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:51.750572 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:51.751005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:51.902666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-ff80e7d3-b658-4dbc-8259-7bb1983b3590 req-cb7dabb9-e51c-4095-bb65-0e459ccffde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "name": "network-vif-unplugged", "status": "completed", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:51.904259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:22:51.904259 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:22:51.911057 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ff80e7d3-b658-4dbc-8259-7bb1983b3590 req-cb7dabb9-e51c-4095-bb65-0e459ccffde0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:51.911491 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ff80e7d3-b658-4dbc-8259-7bb1983b3590 req-cb7dabb9-e51c-4095-bb65-0e459ccffde0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:51.923410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.compute.server_external_events [req-ff80e7d3-b658-4dbc-8259-7bb1983b3590 req-cb7dabb9-e51c-4095-bb65-0e459ccffde0 service nova] Unable to find a host for instance f07f014b-f5d0-4005-b467-e11414c5176f. Dropping event network-vif-unplugged {{(pid=108953) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 23 03:22:51.924264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-ff80e7d3-b658-4dbc-8259-7bb1983b3590 req-cb7dabb9-e51c-4095-bb65-0e459ccffde0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025404 Sep 23 03:22:51.924861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 543/1076] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 23 03:22:52.467828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d7021a09-f9ef-45cc-94b4-73b696ba51eb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments/7218aa0e-89e2-4193-8746-486a2424acaa" status: 202 len: 0 microversion: 2.20 time: 0.728365 Sep 23 03:22:52.468464 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 534/1077] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Sep 23 03:22:51 2021] DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments/7218aa0e-89e2-4193-8746-486a2424acaa => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:22:52.526909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:22:52.527408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:52.533154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:52.533595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:52.534352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:52.534852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:52.788748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [0e3718ed-d1ef-4027-9310-70e6592322ca] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:22:53.805260 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [0e3718ed-d1ef-4027-9310-70e6592322ca] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34678. Sep 23 03:22:53.808866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-475a3bab-95a8-4ce5-bc28-9015d2a36ca4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action" status: 202 len: 0 microversion: 2.20 time: 1.286277 Sep 23 03:22:53.812509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 544/1078] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Sep 23 03:22:52 2021] POST /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/action => generated 0 bytes in 1288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:22:53.821904 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:53.822763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:53.828373 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:53.828846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:53.829614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:53.830044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:53.951730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:53.959619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:53.961128 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:53.962272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c388f477-7a1e-4cad-b63e-4d81262eb453 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1674 microversion: 2.20 time: 0.148375 Sep 23 03:22:53.962836 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 535/1079] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:53 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:54.980750 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:54.981284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:54.987759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:54.988201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:54.988981 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:54.989410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:55.110706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:55.118464 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:55.119948 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:55.121107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f6809479-0614-42ac-a98e-d0329058bc1b tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1674 microversion: 2.20 time: 0.144520 Sep 23 03:22:55.121659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 545/1080] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:54 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:56.138856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:56.139455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:56.145139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:56.145587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:56.146340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:56.146773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:56.314311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:56.321952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:56.323434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:56.324605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-47531e3e-a8ab-43a0-a9ea-6d6ac2c1e87a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1674 microversion: 2.20 time: 0.189510 Sep 23 03:22:56.325171 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 536/1081] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:56 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:57.342960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:57.343590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:57.349599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:57.350047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:57.351293 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:57.351722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:57.519375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:57.527907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:57.529428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:57.530567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-aaa991f6-39a8-4091-bda9-36354c8aa2b0 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1676 microversion: 2.20 time: 0.191445 Sep 23 03:22:57.531132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 546/1082] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:57 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:58.549663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:58.550264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:58.557241 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:58.557686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:58.558480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:58.558909 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:58.681949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:58.691792 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:58.693341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:58.694628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9f3e6330-20a6-4e53-ac12-32f634b8588d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.149280 Sep 23 03:22:58.695019 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 537/1083] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:58 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:22:59.710980 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:22:59.711498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:22:59.717455 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:59.717900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:59.718667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:22:59.719097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:22:59.847398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:59.856055 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:59.857578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:22:59.858735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-277cfe26-457c-414e-b767-e8b7c4bdc894 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.151577 Sep 23 03:22:59.859466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 547/1084] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:22:59 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:00.877244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:01.024083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:01.024083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:01.024083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:01.024083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:01.025204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:01.027761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:01.035976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:01.037492 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:01.039254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c86f3095-242d-4c3a-84a8-f972f99b1311 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.165816 Sep 23 03:23:01.039815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 538/1085] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:00 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:02.057358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:02.058060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:02.064172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:02.064708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:02.065485 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:02.065914 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:02.190477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:02.198920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:02.200452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:02.201621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2cff404e-4ef8-46c4-b14d-649090adf785 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.148114 Sep 23 03:23:02.202177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 548/1086] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:02 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:03.218974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:03.219565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:03.225907 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:03.226343 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:03.227088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:03.227509 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:03.349714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:03.358580 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:03.360127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:03.361304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d57fdbd0-f5c1-4e6b-b323-9f7c3f6e3ef7 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.146090 Sep 23 03:23:03.361857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 539/1087] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:03 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:04.514207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:04.514824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:04.520950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:04.521391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:04.522663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:04.523097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:04.646121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:04.654539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:04.656100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:04.657373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6cdc06e0-4c9b-45fc-9e0f-09a4acf60ceb tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.280428 Sep 23 03:23:04.658229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 549/1088] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:04 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:05.675045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:05.675798 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:05.682385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:05.682820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:05.683573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:05.683993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:05.813309 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:05.822137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:05.823924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:05.825254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d772d878-2736-43e9-a284-fda48f12c290 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.154378 Sep 23 03:23:05.832553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 540/1089] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:05 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:06.843657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:06.849674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:06.850171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:06.850621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:06.851386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:06.851819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:06.988130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:06.996401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:06.997950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:06.999113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-482dd5ec-0d02-4305-bfb2-cddd022ccc0e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.159233 Sep 23 03:23:06.999672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 550/1090] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:06 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:08.017659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:08.019392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:08.027302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:08.028301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:08.030698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:08.031017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:08.171147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:08.179563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:08.181081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:08.182238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0899a824-eaf8-48d5-b014-9a2d82b1d723 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.168352 Sep 23 03:23:08.182801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 541/1091] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:08 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:09.200451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:09.201187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:09.207997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:09.208502 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:09.209884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:09.210353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:09.345420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:09.356354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:09.356354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:09.357440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c80d2d9e-5315-4c51-9519-b8d72c56d467 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.161209 Sep 23 03:23:09.357999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 551/1092] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:09 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:10.377542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:10.378152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:10.383957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:10.384401 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:10.385188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:10.385654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:10.502432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:10.510079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:10.511574 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:10.512762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ad386d62-2f00-4072-ab45-5bbee137a4c4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.138887 Sep 23 03:23:10.513319 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 542/1093] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:10 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:11.530608 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:11.531245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:11.537322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:11.537842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:11.538541 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:11.538979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:11.658042 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:11.666290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:11.667795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:11.668970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7f3d0940-3657-4413-a298-c4dff1bfc45c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.142108 Sep 23 03:23:11.669526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 552/1094] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:11 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:12.686907 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:12.687506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:12.693344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:12.694370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:12.695117 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:12.695544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:12.816596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:12.825185 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:12.828437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:12.828437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fce927b2-553e-4733-9159-dc0ce507db22 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.144568 Sep 23 03:23:12.828437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 543/1095] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:12 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:13.845670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:13.846283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:13.852977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:13.853362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:13.854114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:13.854544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:13.976374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:13.984261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:13.985788 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:13.986924 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ad339528-14f5-422c-b981-d194fa141280 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.145000 Sep 23 03:23:13.987475 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 553/1096] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:13 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:15.004680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:15.005198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:15.011036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:15.016713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:15.016713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:15.016713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:15.131378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:15.139169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:15.140698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:15.141868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9c02bed3-f0a1-4a28-aa06-603d09d99852 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.140988 Sep 23 03:23:15.142421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 544/1097] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:14 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:16.160612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:16.161276 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:16.167797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:16.168309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:16.169107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:16.169530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:16.289115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:16.296802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:16.298305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:16.299451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ca3e7958-8310-411b-b55f-a18667e857e4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.142694 Sep 23 03:23:16.300009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 554/1098] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:16 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:17.317745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:17.318359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:17.324744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:17.325186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:17.325941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:17.326369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:17.441734 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:17.449351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:17.450827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:17.451953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1e2755ff-0ba2-4b51-a76c-4018dd614320 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.137956 Sep 23 03:23:17.452515 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 545/1099] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:17 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:17.976840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-3041849c-34b4-4200-8aa3-e06b91d66f6d req-4807d308-2777-4aa4-ae3b-c0087a347fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "name": "network-vif-plugged", "status": "completed", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:23:17.978630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:23:17.978630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:23:17.985628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-3041849c-34b4-4200-8aa3-e06b91d66f6d req-4807d308-2777-4aa4-ae3b-c0087a347fed service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:17.987460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-3041849c-34b4-4200-8aa3-e06b91d66f6d req-4807d308-2777-4aa4-ae3b-c0087a347fed service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:17.996978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-3041849c-34b4-4200-8aa3-e06b91d66f6d req-4807d308-2777-4aa4-ae3b-c0087a347fed service nova] Creating event network-vif-plugged:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:23:18.002115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-3041849c-34b4-4200-8aa3-e06b91d66f6d req-4807d308-2777-4aa4-ae3b-c0087a347fed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029571 Sep 23 03:23:18.002744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 555/1100] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:23:18.469947 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:18.470547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:18.476818 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:18.477256 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:18.478250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:18.478675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:18.598815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:18.607340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:18.608853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:18.609984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-47073494-27c5-497f-9de1-f5e75b368df2 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.143732 Sep 23 03:23:18.610530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 546/1101] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:18 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:19.627570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:19.628244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:19.634910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:19.635344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:19.636101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:19.636545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:19.759693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:19.767252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:19.768757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:19.769892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-35851759-4905-4c8d-a47f-d1502f49dd57 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.146458 Sep 23 03:23:19.770441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 556/1102] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:19 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:20.788658 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:20.789257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:20.795079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:20.795528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:20.796340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:20.796799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:20.916605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:20.924422 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:20.925950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:20.927094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-468c7e30-767d-4b62-9932-be738a048187 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1732 microversion: 2.20 time: 0.142681 Sep 23 03:23:20.927656 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 547/1103] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:20 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1732 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:21.945810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:23:21.946338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:23:21.952147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:21.952617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:21.953371 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:23:21.953796 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:23:22.072613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:22.080286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:22.081813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:23:22.082944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-12a97b61-a3c6-4d90-8977-09c73abf728c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1719 microversion: 2.20 time: 0.141562 Sep 23 03:23:22.083507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 557/1104] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:23:21 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1719 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:23:37.701999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:23:37.702584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:23:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:24:17.598217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:17.599204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:17.605641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:17.606084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:17.606845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:17.607275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:17.635846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cba03d4c-f246-49e3-ac87-70efc3698a91 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041921 Sep 23 03:24:17.636383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 548/1105] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Sep 23 03:24:17 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:17.695756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:17.696254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:17.702224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:17.702661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:17.703410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:17.703834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:17.727873 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:24:18.032996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1f92ce60-4516-4c4b-b25f-90ba5df83473 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 204 len: 0 microversion: 2.20 time: 0.340534 Sep 23 03:24:18.033583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 558/1106] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Sep 23 03:24:17 2021] DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:24:18.042014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:18.042612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:18.048295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:18.048775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:18.049524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:18.049948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:18.168714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:18.176336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:18.177862 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:18.179007 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f7aca932-2f26-4a3f-a1a1-01409690a6b4 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.140742 Sep 23 03:24:18.179557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 549/1107] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:24:18 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:24:19.197846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:19.198700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:19.204340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:19.204807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:19.205554 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:19.205978 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:19.323893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:19.331416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:19.333565 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:19.334692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bee337a8-c4f9-4e81-ae9a-9e3875a57c5a tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.140935 Sep 23 03:24:19.335251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 559/1108] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:24:19 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 03:24:20.353036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:20.353597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:20.359289 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:20.359728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:20.360480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:20.360986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:20.483035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:20.491041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:20.492664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:20.493855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc15eb96-a3ba-47da-93b5-d33b48a1de1c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1725 microversion: 2.20 time: 0.144998 Sep 23 03:24:20.494411 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 550/1109] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:24:20 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:24:20.733594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1bf352b4-a815-4c20-b7fb-b119b16810ab req-ae701747-d6f7-4d2d-a8b2-1576946291d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f014b-f5d0-4005-b467-e11414c5176f", "name": "network-vif-deleted", "tag": "88c145bd-9b48-497d-87f5-a0b8a59af425"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:20.735175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:24:20.735175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:24:20.741907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1bf352b4-a815-4c20-b7fb-b119b16810ab req-ae701747-d6f7-4d2d-a8b2-1576946291d3 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:20.744452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1bf352b4-a815-4c20-b7fb-b119b16810ab req-ae701747-d6f7-4d2d-a8b2-1576946291d3 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:20.753303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1bf352b4-a815-4c20-b7fb-b119b16810ab req-ae701747-d6f7-4d2d-a8b2-1576946291d3 service nova] Creating event network-vif-deleted:88c145bd-9b48-497d-87f5-a0b8a59af425 for instance f07f014b-f5d0-4005-b467-e11414c5176f on hv-cinder-76845 Sep 23 03:24:20.758633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1bf352b4-a815-4c20-b7fb-b119b16810ab req-ae701747-d6f7-4d2d-a8b2-1576946291d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028654 Sep 23 03:24:20.759215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 560/1110] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:24:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:24:21.516665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:21.516665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:21.520157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:21.520885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:21.522112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:21.522434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:21.558523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:21.559048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:21.559507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lazy-loading 'fault' on Instance uuid f07f014b-f5d0-4005-b467-e11414c5176f {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:24:21.601456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:21.609121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:21.610615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bea2a7d9c3724d8b947a0a6363d2f5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfca1e34b884266a4b529b2813872ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:21.611747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-87296427-cf01-43cd-9a8f-75e23de3cf20 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 200 len: 1372 microversion: 2.20 time: 0.103001 Sep 23 03:24:21.612302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 551/1111] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:24:21 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 03:24:22.635096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:22.635777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:22.641922 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:22.642374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:22.643136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:22.643601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:22.657684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. Sep 23 03:24:22.658258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:24:22.659085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9b902c50-c76c-48c8-bab3-6e51e947635c tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 404 len: 111 microversion: 2.20 time: 0.028183 Sep 23 03:24:22.659594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 561/1112] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Sep 23 03:24:22 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 03:24:22.668092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-99b2e3c8-4774-442b-a800-dcb38d5f0b94 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '.version_select at 0x7fd1b4103f70>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:22.757612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-99b2e3c8-4774-442b-a800-dcb38d5f0b94 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836668860" status: 204 len: 0 microversion: 2.20 time: 0.093040 Sep 23 03:24:22.758157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 552/1113] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Sep 23 03:24:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836668860 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 03:24:25.068048 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:25.068575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:25.074414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:25.074862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:25.075649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:25.076079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:25.089730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. Sep 23 03:24:25.090301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:24:25.091148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c6e8528d-0b03-49ea-af35-1dc18520593d tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 404 len: 111 microversion: 2.1 time: 0.027225 Sep 23 03:24:25.091656 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 562/1114] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:24:25 2021] DELETE /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:24:25.099223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:25.099828 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: f07f014b-f5d0-4005-b467-e11414c5176f] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:25.105922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:25.106387 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:25.107139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:25.107558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:25.120325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. Sep 23 03:24:25.120922 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance f07f014b-f5d0-4005-b467-e11414c5176f could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:24:25.121706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c3381d4a-9584-4984-b7ca-9a31bfba324e tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f" status: 404 len: 111 microversion: 2.1 time: 0.026161 Sep 23 03:24:25.122204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 553/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:25 2021] GET /compute/v2.1/servers/f07f014b-f5d0-4005-b467-e11414c5176f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:24:26.434456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:26.434989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:26.437325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 03:24:26.442161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:26.442642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:26.443353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:26.443781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:26.456709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. Sep 23 03:24:26.457886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:24:26.458697 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b1b8de44-3b71-4ea3-85da-c32433606a26 tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 404 len: 111 microversion: 2.1 time: 0.027943 Sep 23 03:24:26.459205 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 563/1116] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:24:26 2021] DELETE /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:24:26.472416 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:26.473096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] [instance: 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:26.479045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:26.479482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:26.480228 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:26.480703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:26.493543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] HTTP exception thrown: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. Sep 23 03:24:26.494733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] Returning 404 to user: Instance 7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:24:26.494875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e70439bb-2b22-4f96-a7bd-4c32c703490f tempest-AttachVolumeShelveTestJSON-168478597 tempest-AttachVolumeShelveTestJSON-168478597-project] 10.222.0.23 "GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a" status: 404 len: 111 microversion: 2.1 time: 0.026127 Sep 23 03:24:26.495376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 554/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:26 2021] GET /compute/v2.1/servers/7b5e61b2-2f6c-4450-a5c3-c6bd65ec328a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:24:37.268725 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34964. Sep 23 03:24:37.370266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: .version_select at 0x7fd1b40d1f70>, body: {"keypair": {"name": "tempest-keypair-2072528115"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:37.393256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:24:37.397159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:24:37.409110 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [a693c849-4a67-4e3b-8fd9-6936f9c78099] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:24:38.425817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [a693c849-4a67-4e3b-8fd9-6936f9c78099] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34966. Sep 23 03:24:39.048230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:24:39.052683 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:24:39.066482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6d53c8a7-e72b-4267-a9d1-c860b4e44648 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.818293 Sep 23 03:24:39.067158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 564/1118] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Sep 23 03:24:37 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:41.256757 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-646632530", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92c029f-810f-4549-a812-649ee96dc75b"}], "security_groups": [{"name": "tempest-securitygroup--2125155322"}], "key_name": "tempest-keypair-2072528115", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:41.263633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 03:24:41.348038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] validate_networks() for [('b92c029f-810f-4549-a812-649ee96dc75b', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:24:41.782434 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:24:41.782879 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:24:41.783344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:24:41.783741 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:24:41.784144 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:24:41.792957 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:41.793433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:41.794236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:41.794667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:41.810595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:24:41.814439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:24:41.825827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:24:41.828155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:24:41.946568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d3c9ace2-d119-4a17-8d2d-bb52dae9c666 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694540 Sep 23 03:24:41.947209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 555/1119] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:24:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:24:41.957020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-516e897e-4832-4e3a-a0c8-7289b1462c46 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:41.957625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-516e897e-4832-4e3a-a0c8-7289b1462c46 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:42.012061 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-516e897e-4832-4e3a-a0c8-7289b1462c46 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:42.018515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-516e897e-4832-4e3a-a0c8-7289b1462c46 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1237 microversion: 2.1 time: 0.065292 Sep 23 03:24:42.019216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 565/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:41 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:43.045266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8c9a2353-e397-435f-8877-bb841431328c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:43.045871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8c9a2353-e397-435f-8877-bb841431328c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:43.055705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35008. Sep 23 03:24:43.100256 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8c9a2353-e397-435f-8877-bb841431328c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:43.107601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8c9a2353-e397-435f-8877-bb841431328c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1237 microversion: 2.1 time: 0.076274 Sep 23 03:24:43.108186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 556/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:43 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:44.123938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:44.124574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:44.131047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:44.131488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:44.132250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:44.132714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:44.191251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:44.198526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a886ccd9-f6d5-47be-a0b5-563d050bfa79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1289 microversion: 2.1 time: 0.078341 Sep 23 03:24:44.199105 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 566/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:44 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:45.215213 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:45.215815 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:45.226077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:45.226077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:45.226077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:45.226077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:45.350404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:45.359306 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-02ac918a-c71a-4601-a4d8-9a09df3664c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.147848 Sep 23 03:24:45.359868 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 557/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:45 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:46.156549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-4369d5c9-c9c9-4ab1-8c3e-7e24bdf82018 req-726625a9-171d-4797-8f27-495931fa96c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db993b7a-3b47-46ed-846f-75a26878be5b", "tag": "fb38e51e-efa4-4206-a272-d5b4cb1b046e"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:46.158221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:24:46.158221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:24:46.166193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-4369d5c9-c9c9-4ab1-8c3e-7e24bdf82018 req-726625a9-171d-4797-8f27-495931fa96c5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:46.166717 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-4369d5c9-c9c9-4ab1-8c3e-7e24bdf82018 req-726625a9-171d-4797-8f27-495931fa96c5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:46.178132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-4369d5c9-c9c9-4ab1-8c3e-7e24bdf82018 req-726625a9-171d-4797-8f27-495931fa96c5 service nova] Creating event network-changed:fb38e51e-efa4-4206-a272-d5b4cb1b046e for instance db993b7a-3b47-46ed-846f-75a26878be5b on hv-cinder-76845 Sep 23 03:24:46.183239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-4369d5c9-c9c9-4ab1-8c3e-7e24bdf82018 req-726625a9-171d-4797-8f27-495931fa96c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099809 Sep 23 03:24:46.183842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 567/1124] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:24:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:24:46.376608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:46.377253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:46.383781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:46.384257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:46.385052 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:46.395323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:46.510649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:46.517981 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-752a171a-a884-4e06-bfa6-3de6ae448038 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.145152 Sep 23 03:24:46.518819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 558/1125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:46 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:47.535891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:47.536614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:47.542885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:47.543322 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:47.544079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:47.544515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:47.673861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:47.681016 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6aa6a138-e3db-42f7-a4db-0e1f4cfab92b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.149899 Sep 23 03:24:47.681581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 568/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:47 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:48.697388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:48.697996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:48.703822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:48.704267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:48.705046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:48.705476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:48.823567 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:48.830685 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c1d7ebc8-2eaa-422d-8595-74a0362e5e91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.136991 Sep 23 03:24:48.831290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 559/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:48 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:49.624791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:49.625335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:49.631132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:49.631566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:49.632310 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:49.632758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:49.654737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lazy-loading 'flavor' on Instance uuid 9fbba714-1d40-419f-865c-d0346b7ac67e {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:24:49.847376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:49.847988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:49.854110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:49.854553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:49.855313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:49.855729 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:49.971391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:49.979377 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c87b4d43-5beb-4ba6-bada-da432af4727f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.136255 Sep 23 03:24:49.979952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 560/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:49 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:24:50.159251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-683cb6f0-58b7-472d-bb2a-00d567bb8bf0 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "POST /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e/action" status: 202 len: 0 microversion: 2.1 time: 0.537773 Sep 23 03:24:50.159757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 569/1129] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:24:49 2021] POST /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:24:50.167810 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:50.168421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:50.174345 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:50.174794 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:50.175554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:50.175988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:50.301617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:50.308840 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4d6eeca8-9b1b-48d6-aba9-9421083032eb tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.144678 Sep 23 03:24:50.309399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 561/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:50 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:50.996169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:50.996898 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:51.002822 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:51.003768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:51.004552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:51.005014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:51.128648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:51.135850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-86e30b54-f85a-4d7a-8356-ea7b66419179 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.143702 Sep 23 03:24:51.136414 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 570/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:50 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:51.326418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:51.327431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:51.334686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:51.335138 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:51.335897 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:51.336362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:51.468262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:51.476374 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e3d0e7d9-cc21-4a21-a3b3-a476078b346c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.154265 Sep 23 03:24:51.476972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 562/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:51 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:52.152832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:52.153412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:52.159149 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:52.159593 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:52.160345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:52.160799 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:52.279197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:52.286434 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b43dc428-5ed7-405a-9f86-c39cd2e9b83d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.137392 Sep 23 03:24:52.286989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 571/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:52 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:52.493465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:52.494073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:52.499718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:52.500162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:52.500945 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:52.501376 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:52.566067 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-ecbfa96e-195c-4073-9910-55467543da37 req-0d36956b-f983-4c31-a57d-a7593d321c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db993b7a-3b47-46ed-846f-75a26878be5b", "name": "network-vif-plugged", "status": "completed", "tag": "fb38e51e-efa4-4206-a272-d5b4cb1b046e"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:52.567588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:24:52.567588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:24:52.574721 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ecbfa96e-195c-4073-9910-55467543da37 req-0d36956b-f983-4c31-a57d-a7593d321c31 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:52.578114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-ecbfa96e-195c-4073-9910-55467543da37 req-0d36956b-f983-4c31-a57d-a7593d321c31 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:52.587421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-ecbfa96e-195c-4073-9910-55467543da37 req-0d36956b-f983-4c31-a57d-a7593d321c31 service nova] Creating event network-vif-plugged:fb38e51e-efa4-4206-a272-d5b4cb1b046e for instance db993b7a-3b47-46ed-846f-75a26878be5b on hv-cinder-76845 Sep 23 03:24:52.592317 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-ecbfa96e-195c-4073-9910-55467543da37 req-0d36956b-f983-4c31-a57d-a7593d321c31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029971 Sep 23 03:24:52.592950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 572/1134] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:24:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:24:52.626743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:52.637179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-55df8d44-4067-4a89-99b5-5e5773ec4ad2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.147398 Sep 23 03:24:52.637770 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 563/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:52 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:53.303875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:53.304589 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:53.310599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:53.311038 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:53.311791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:53.312219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:53.432905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:53.440128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bb48d665-d439-4a14-8b08-030f2a7da254 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.140814 Sep 23 03:24:53.440723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 573/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:53 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:53.654134 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:53.654732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:53.660996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:53.661437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:53.662188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:53.662615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:53.786742 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:53.794253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-03af4c97-5d96-4e6d-a301-d00ddd2b32b5 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.144176 Sep 23 03:24:53.794812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 564/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:53 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:54.457005 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:54.457661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:54.463509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:54.463952 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:54.464735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:54.465168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:54.584571 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:54.591732 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-adf0e137-fe2b-4923-975b-6a8fd2dab473 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1363 microversion: 2.1 time: 0.138660 Sep 23 03:24:54.592300 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 574/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:54 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:54.810995 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:54.811595 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:54.818269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:54.818705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:54.819450 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:54.819875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:54.943555 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:54.950760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2568f607-8185-48d1-ad7e-daf3586ab08f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.143558 Sep 23 03:24:54.951322 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 565/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:54 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:55.609891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:55.610480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:55.616326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.616801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:55.617556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.617983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:55.739311 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:55.746487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-44d3cb3e-d5e6-435c-a32d-2b3151b83c55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1550 microversion: 2.1 time: 0.140351 Sep 23 03:24:55.747051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 575/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:55 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1550 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:55.762756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:55.763246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:55.768975 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.769415 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:55.770168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.770594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:55.847436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bf3bd174-e24f-4069-a960-e5e6268669ca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088273 Sep 23 03:24:55.848035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 566/1141] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Sep 23 03:24:55 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:24:55.966995 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:55.967731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:55.973510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.973951 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:55.974707 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:55.975134 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:56.093663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:56.101150 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f7dbbd5d-09a6-4b92-b54a-e3e09ca97fc2 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.137599 Sep 23 03:24:56.101728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 576/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:55 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:56.806296 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:56.807856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:56.814146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-fcfd29f4-24ff-44f2-bfdc-a1dea908bcd9 req-38d6563d-d17f-479a-9998-8079629d8e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db993b7a-3b47-46ed-846f-75a26878be5b", "tag": "fb38e51e-efa4-4206-a272-d5b4cb1b046e"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:56.815741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:24:56.815741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:24:56.821891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:56.822088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:56.822851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:56.823274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:56.832339 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fcfd29f4-24ff-44f2-bfdc-a1dea908bcd9 req-38d6563d-d17f-479a-9998-8079629d8e54 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:56.832813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fcfd29f4-24ff-44f2-bfdc-a1dea908bcd9 req-38d6563d-d17f-479a-9998-8079629d8e54 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:56.844070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-fcfd29f4-24ff-44f2-bfdc-a1dea908bcd9 req-38d6563d-d17f-479a-9998-8079629d8e54 service nova] Creating event network-changed:fb38e51e-efa4-4206-a272-d5b4cb1b046e for instance db993b7a-3b47-46ed-846f-75a26878be5b on hv-cinder-76845 Sep 23 03:24:56.850726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-fcfd29f4-24ff-44f2-bfdc-a1dea908bcd9 req-38d6563d-d17f-479a-9998-8079629d8e54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038962 Sep 23 03:24:56.850726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 577/1143] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:24:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:24:56.859471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [1743bbb0-0e4b-410f-9c1f-d571b28a67f2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:24:57.118634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:57.119330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:57.125638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:57.128668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:57.128668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:57.128982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:57.291575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:57.299354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-19b197d7-adbe-4dab-9a27-02edee62dc86 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.185059 Sep 23 03:24:57.299986 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 578/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:57 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:57.875222 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [1743bbb0-0e4b-410f-9c1f-d571b28a67f2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35066. Sep 23 03:24:57.935062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-330fe887-c231-4b67-baa6-4b9d8a3ab4a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 1.127634 Sep 23 03:24:57.935062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 567/1145] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:24:56 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:24:58.316320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:58.316951 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:58.322814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:58.323252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:58.324001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:58.324428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:58.444444 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:58.451602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8c8f99f7-9e3f-45d8-af6d-b8a299ac669e tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.138973 Sep 23 03:24:58.452164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 579/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:58 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:24:58.941430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:24:58.942427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:58.948984 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:58.949430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:58.950190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:58.950622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:59.036027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-568425fb-0977-49b3-8f02-9ea4093a062e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.098550 Sep 23 03:24:59.036679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 568/1147] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:24:58 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:24:59.468565 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:24:59.469173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:24:59.474987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:59.475679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:59.476437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:24:59.476883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:24:59.594452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:24:59.604193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3936f8ea-61ed-408e-9f6c-a7871b6e5b8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.139367 Sep 23 03:24:59.604779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 580/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:24:59 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:00.047335 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:00.048323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:00.055527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:00.055974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:00.056781 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:00.057215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:00.138062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-af50812c-03fc-4072-a7d3-a6a9b7951e2a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.094532 Sep 23 03:25:00.138617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 569/1149] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:00 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:25:00.621357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:00.621966 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:00.628848 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:00.629282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:00.630033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:00.630458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:00.822885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:00.830360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9fc31635-1f2d-4409-ac38-51d2d41f769d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.212633 Sep 23 03:25:00.831021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 581/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:00 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:01.149521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:01.150442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:01.156892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:01.157336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:01.158089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:01.158520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:01.244677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8825480c-55a5-46e3-a565-c440ba50a81d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.099138 Sep 23 03:25:01.245282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 570/1151] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:01 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:25:01.847583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:01.848186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:01.854318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:01.854760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:01.855509 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:01.855931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:01.974239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:01.981663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5a7a3a3d-485a-4a83-a20c-630cba6e1738 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.138317 Sep 23 03:25:01.982253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 582/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:01 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:02.256071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:02.257082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:02.263438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:02.263874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:02.264654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:02.265078 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:02.376646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-85c42819-68a1-490a-bdeb-a5287d40cdc3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.124984 Sep 23 03:25:02.377227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 571/1153] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:02 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:25:02.998374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:02.998943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:03.005324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:03.005768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:03.006527 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:03.006962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:03.123681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:03.131468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-755cf770-132e-4c30-9430-69c0c0027f8f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.136906 Sep 23 03:25:03.132032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 583/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:02 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:03.394309 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:03.395280 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:03.401763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:03.402207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:03.403025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:03.403455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:03.486512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-00e5de8a-efed-4219-969d-282a7b67b37d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.095993 Sep 23 03:25:03.487880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 572/1155] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:03 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:25:04.148822 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:04.149432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:04.155184 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.155624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.156407 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.156860 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.273548 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:04.280897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b8c992da-c987-4a13-ae75-d9ecfe59d5e8 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1570 microversion: 2.1 time: 0.135678 Sep 23 03:25:04.281467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 584/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:04 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1570 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:04.297535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:04.302069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:04.304668 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.305116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.305878 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.306313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.497505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:04.498342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:04.504749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.505189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.505943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.506367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.587687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-59ea4ed3-5731-4247-965f-232a6e79e6b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.093750 Sep 23 03:25:04.588324 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 585/1157] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:04 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:25:04.617845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b4df20b4-5731-4886-a4ef-207e827d6bef tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "POST /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e/action" status: 202 len: 0 microversion: 2.1 time: 0.324347 Sep 23 03:25:04.618615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 573/1158] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:04 2021] POST /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:25:04.626621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:04.628221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:04.634395 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.634838 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:04.635666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:04.636098 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:05.008850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:05.016177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ddd750e5-8961-416a-937c-2887a6cea939 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1518 microversion: 2.1 time: 0.393483 Sep 23 03:25:05.016774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 586/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:04 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1518 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:05.602014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:05.603979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:05.609942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:05.610379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:05.611146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:05.611571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:05.711597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fb1b8b5b-6bb1-4061-955f-a672917d8435 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 14 microversion: 2.1 time: 0.116751 Sep 23 03:25:05.712165 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 574/1160] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:05 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:25:06.033243 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:06.037487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:06.039995 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:06.040437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:06.041264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:06.041692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:06.158198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:06.165590 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0207e25c-1859-40bd-8e5e-f1894aa18ea6 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1520 microversion: 2.1 time: 0.136027 Sep 23 03:25:06.166148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 587/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:06 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1520 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:06.518819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-a62d74fa-12d0-47ae-b93a-11f87ee290de req-2100ba2d-55cb-4fcb-a85d-e6274ec64b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "name": "network-vif-unplugged", "status": "completed", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:06.520340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:25:06.520340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:25:06.527360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-a62d74fa-12d0-47ae-b93a-11f87ee290de req-2100ba2d-55cb-4fcb-a85d-e6274ec64b28 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:06.527822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-a62d74fa-12d0-47ae-b93a-11f87ee290de req-2100ba2d-55cb-4fcb-a85d-e6274ec64b28 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:06.539155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.compute.server_external_events [req-a62d74fa-12d0-47ae-b93a-11f87ee290de req-2100ba2d-55cb-4fcb-a85d-e6274ec64b28 service nova] Unable to find a host for instance 9fbba714-1d40-419f-865c-d0346b7ac67e. Dropping event network-vif-unplugged {{(pid=108954) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 23 03:25:06.540290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-a62d74fa-12d0-47ae-b93a-11f87ee290de req-2100ba2d-55cb-4fcb-a85d-e6274ec64b28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084788 Sep 23 03:25:06.540908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 575/1162] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:25:06 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 03:25:06.722066 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:06.722972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:06.728940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:06.729382 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:06.730124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:06.730547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:06.828734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-34ec4c4a-8dff-4aaa-bb0f-7e35244c5b2b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 4541 microversion: 2.1 time: 0.110233 Sep 23 03:25:06.829487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 588/1163] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:06 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 4541 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:25:07.183103 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:07.183819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:07.189568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:07.190077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:07.190824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:07.191248 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:07.314718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:07.321923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d80cfd74-9629-4125-8b80-ceeb727bf5ce tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.142471 Sep 23 03:25:07.322476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 576/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:07 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:07.840467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:07.841474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:07.847825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:07.848265 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:07.849081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:07.849506 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:07.944888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-91881c5e-97ec-4938-aef8-3b498a044401 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 15025 microversion: 2.1 time: 0.108401 Sep 23 03:25:07.945542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 589/1165] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:07 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 15025 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:08.338495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:08.339095 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:08.345435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:08.345872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:08.347200 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:08.347622 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:08.466317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:08.472845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fa5304b4-41ce-4d39-960b-9f9c8e412d3c tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.138138 Sep 23 03:25:08.473409 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 577/1166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:08 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:08.957086 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:08.958070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:08.964422 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:08.964888 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:08.965636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:08.966059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:09.077839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b4e90a76-d264-40d4-b57a-7a0ffb396ecc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 18498 microversion: 2.1 time: 0.125093 Sep 23 03:25:09.078616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 590/1167] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:08 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 18498 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:09.489384 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:09.489924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:09.495696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:09.496139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:09.496936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:09.497356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:09.620890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:09.628633 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c17127da-9c73-4003-9623-7debc19023b4 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.142969 Sep 23 03:25:09.629203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 578/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:09 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:10.090087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:10.091034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:10.098244 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:10.098689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:10.099444 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:10.099870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:10.192511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9a0e5711-1488-44f5-a513-34da266b56fd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 19342 microversion: 2.1 time: 0.106463 Sep 23 03:25:10.193122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 591/1169] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:10 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 19342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:10.645601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:10.646215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:10.652467 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:10.652944 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:10.653705 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:10.654136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:10.775063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:10.782166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-413fe4a9-879f-4229-95d7-a30bfce44451 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.140740 Sep 23 03:25:10.782720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 579/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:10 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:11.204453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:11.205473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:11.212437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:11.212905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:11.213659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:11.214083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:11.307424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-17b61e08-2eff-4e6d-997f-2d978e1b4779 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 22217 microversion: 2.1 time: 0.106833 Sep 23 03:25:11.308060 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 592/1171] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:11 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 22217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:11.798738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:11.799941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:11.805719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:11.806153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:11.806896 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:11.807318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:11.928412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:11.935715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f7022708-dc3c-495d-abad-43e421a19f8d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.140636 Sep 23 03:25:11.936282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 580/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:11 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:25:12.319477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:12.320469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:12.326901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:12.327281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:12.328040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:12.328463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:12.428096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7c4e3c4f-1dfe-4a4a-b680-32ba03b00b61 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 23659 microversion: 2.1 time: 0.112508 Sep 23 03:25:12.428761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 593/1173] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:12 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 23659 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:12.952126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:12.952748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:12.958488 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:12.958924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:12.959661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:12.960079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:13.077212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:13.084920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d456b1e8-c606-498f-9563-c677de2bd75d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.136450 Sep 23 03:25:13.085477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 581/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:12 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:13.440224 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:13.441158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:13.447665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:13.448104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:13.448890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:13.449320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:13.550535 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c0659bd9-3682-40b4-8c01-47978fcc4ff6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 25127 microversion: 2.1 time: 0.114334 Sep 23 03:25:13.551178 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 594/1175] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:13 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 25127 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:14.101920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:14.102461 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:14.108246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:14.108712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:14.109453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:14.109874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:14.236342 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:14.243500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-19333466-c940-45d4-9120-0ff623d2a693 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.145533 Sep 23 03:25:14.244059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 582/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:14 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:14.562474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:14.563467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:14.570473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:14.570916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:14.571677 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:14.572118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:14.665409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-31904c64-c055-4069-ab68-0fb0e4b4772d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 26616 microversion: 2.1 time: 0.106838 Sep 23 03:25:14.666025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 595/1177] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:14 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 26616 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:15.260005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:15.260540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:15.266311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:15.266747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:15.267496 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:15.268532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:15.383899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:15.391201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f8bd1710-4be8-4728-b393-71fb01b597cd tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.134958 Sep 23 03:25:15.391774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 583/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:15 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:15.677534 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:15.678531 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:15.685020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:15.685461 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:15.686216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:15.686643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:15.782230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a216467a-f7d3-47d2-b29c-66edc3d5554c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 27610 microversion: 2.1 time: 0.108673 Sep 23 03:25:15.782842 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 596/1179] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:15 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 27610 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:16.408017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:16.408663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:16.414327 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:16.414763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:16.415508 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:16.415935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:16.535760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:16.543625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ec720e00-f184-4edb-b1d0-8cd4e2e6d0e1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.139237 Sep 23 03:25:16.548339 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 584/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:16 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:16.796092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:16.797953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:16.805096 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:16.805569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:16.806358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:16.806791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:16.984508 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1cb9e13e-61a1-473c-b0b8-01589c96e1d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 27920 microversion: 2.1 time: 0.193501 Sep 23 03:25:16.985340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 597/1181] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:16 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 27920 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:17.561009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:17.561612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:17.568348 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:17.568825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:17.569596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:17.570019 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:17.905812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:17.913713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-78935b9b-1fd6-4fc7-9d4d-7cc7d605c4a3 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.356421 Sep 23 03:25:17.914272 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 585/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:17 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:17.997219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:17.998219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:18.004719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:18.005167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:18.005933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:18.006413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:18.112576 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1a53d650-246a-4c2b-b1a0-e92bb64fb595 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.119056 Sep 23 03:25:18.113505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 598/1183] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:17 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:18.590405 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-b22838e6-6cd2-474d-bb29-3db33e6e0e39 req-4f1727ac-bbd5-4e29-a01d-30cf7798966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "name": "network-vif-plugged", "status": "completed", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:18.591823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:25:18.591823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:25:18.598402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b22838e6-6cd2-474d-bb29-3db33e6e0e39 req-4f1727ac-bbd5-4e29-a01d-30cf7798966d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:18.598833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b22838e6-6cd2-474d-bb29-3db33e6e0e39 req-4f1727ac-bbd5-4e29-a01d-30cf7798966d service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:18.611402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-b22838e6-6cd2-474d-bb29-3db33e6e0e39 req-4f1727ac-bbd5-4e29-a01d-30cf7798966d service nova] Creating event network-vif-plugged:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:25:18.614338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-b22838e6-6cd2-474d-bb29-3db33e6e0e39 req-4f1727ac-bbd5-4e29-a01d-30cf7798966d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028798 Sep 23 03:25:18.614901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 586/1184] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:25:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:25:18.931058 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:18.931754 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:18.938196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:18.938610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:18.939964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:18.940400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:19.059328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:19.067146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b2f285df-b7e3-4e5e-9097-8a1362c69b61 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.140230 Sep 23 03:25:19.067702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 599/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:18 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:19.123394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:19.124407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:19.131231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:19.131664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:19.132406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:19.132855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:19.416889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6f17f58f-32b3-478f-b25e-0ac57d54621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.297126 Sep 23 03:25:19.417579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 587/1186] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:19 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:20.083783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:20.084283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:20.090703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:20.091141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:20.091900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:20.092325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:20.213496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:20.220905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-38f60a8d-8b34-4224-93e8-0a19010aa32d tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1576 microversion: 2.1 time: 0.141378 Sep 23 03:25:20.221665 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:20 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:20.432452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:20.433386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:20.440407 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:20.440875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:20.441663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:20.442087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:20.525444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5fa951dd-9db7-4897-b0db-8384b8418348 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.098808 Sep 23 03:25:20.526029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 588/1188] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:20 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:21.238235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:25:21.238775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:21.244618 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:21.245062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:21.245813 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:21.246243 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:21.366286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:25:21.373533 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3906d250-722e-4e1d-a0c8-0cefe2afefe1 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1563 microversion: 2.1 time: 0.139048 Sep 23 03:25:21.374092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 601/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:25:21 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:25:21.537270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:21.541473 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:21.544980 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:21.545426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:21.546187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:21.546616 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:21.629273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-12a464f4-d31a-4098-8b76-810f2580c502 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.095881 Sep 23 03:25:21.629951 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 589/1190] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:21 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:25:22.640695 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:22.641604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:22.648262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:22.648729 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:22.649478 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:22.649900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:22.731479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9736c639-8f08-4957-b73e-2f948e1b5a25 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.094391 Sep 23 03:25:22.732076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 602/1191] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:22 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:23.743526 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:23.744529 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:23.750905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:23.751349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:23.752105 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:23.753062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:23.833993 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ed9abc29-2a5c-4cb4-b4ec-a006a887a6f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.094362 Sep 23 03:25:23.834643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 590/1192] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:23 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:24.846387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:24.847405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:24.853751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:24.854188 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:24.854932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:24.855353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:24.943305 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-97b7ab71-bc53-44fc-b09a-d986543ad567 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.101469 Sep 23 03:25:24.943923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 603/1193] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:24 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:25.955392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:25.956388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:25.962823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:25.963266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:25.964054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:25.964481 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:26.045789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-419b4f81-a476-46a2-a9df-f56708684f92 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.094295 Sep 23 03:25:26.046420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 591/1194] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:25 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:27.058437 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:27.059480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:27.065910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:27.066343 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:27.067139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:27.067562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:27.156090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-02335c1f-f07a-44ba-a78c-90504a53459f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.101411 Sep 23 03:25:27.156965 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 604/1195] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:27 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:28.168554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:28.169644 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:28.182824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:28.183274 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:28.184055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:28.184500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:28.270192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1989e783-8b24-4bde-8725-30866e71d35d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.105861 Sep 23 03:25:28.270874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 592/1196] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:28 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:29.282572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:29.284147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:29.290601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:29.291094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:29.291862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:29.292291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:29.379415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6f09cb0b-652e-484b-a9ae-7d62bc64142b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.100896 Sep 23 03:25:29.380037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 605/1197] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:29 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:30.393772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:30.395074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:30.401802 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:30.402234 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:30.402983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:30.403527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:30.499544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1478d04e-fabe-4a74-a1c0-94dfb7e73515 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28216 microversion: 2.1 time: 0.111162 Sep 23 03:25:30.500463 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 593/1198] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:30 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:31.511648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:31.512704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:31.519711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:31.520152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:31.520939 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:31.521366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:31.620408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4a849446-7fe0-4607-99d2-e3cf9c8648cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28507 microversion: 2.1 time: 0.112656 Sep 23 03:25:31.621076 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 606/1199] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:31 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28507 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:32.632902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:32.633880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:32.640230 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:32.640702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:32.641454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:32.641872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:32.730663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c2304742-97c9-4668-b9b1-54ab819e0165 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28507 microversion: 2.1 time: 0.101688 Sep 23 03:25:32.731262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 594/1200] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:32 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28507 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:33.742815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:33.743855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:33.750294 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:33.750739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:33.751517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:33.751932 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:33.858329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1e21ad6b-be0a-4a1a-8c62-cbe5927cd09c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.119358 Sep 23 03:25:33.858984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 607/1201] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:33 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:34.870695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:34.871706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:34.878598 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:34.885363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:34.885363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:34.885363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:34.971674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3f9b3412-a6c5-402d-83e5-69949dd242c1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.104861 Sep 23 03:25:34.972282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 595/1202] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:34 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:35.983946 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:35.984967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:35.991443 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:35.991886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:35.992700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:35.993154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:36.082987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-95027e8f-c75d-402d-ade7-2ed260c1d60e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.102895 Sep 23 03:25:36.083551 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 608/1203] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:35 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:37.094256 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:37.095223 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:37.101866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:37.102310 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:37.103064 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:37.103494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:37.202238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a56f9131-c9d5-4111-96c3-d7c4fdec1ed9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.111880 Sep 23 03:25:37.202880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 596/1204] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:37 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:38.215124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:38.216030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:38.223166 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:38.223608 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:38.224373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:38.225091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:38.309173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37ce9a9e-46da-47e5-b1df-bddb1b3f697a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.098056 Sep 23 03:25:38.309771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 609/1205] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:38 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:39.321239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:39.322220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:39.328667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:39.329051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:39.329799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:39.330257 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:39.417773 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b8999cb9-2afc-4553-a241-75edf7734f33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.100632 Sep 23 03:25:39.418431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 597/1206] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:39 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:40.430245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:40.431241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:40.437728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:40.438175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:40.438938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:40.439372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:40.525797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-936b0c77-a657-4da0-8b3f-cf5df8729fc5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.099450 Sep 23 03:25:40.526410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 610/1207] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:40 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:41.538565 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:41.539549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:41.545980 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:41.546417 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:41.547161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:41.547586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:41.638492 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5f95966a-f561-4d8d-bc75-53ca2a139c2d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.104276 Sep 23 03:25:41.639161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 598/1208] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:41 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:25:42.651154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:42.652176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:42.658628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:42.659071 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:42.660431 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:42.660878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:42.750473 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d8c2442-67ab-4271-81cc-18debbccfca4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.103341 Sep 23 03:25:42.751081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 611/1209] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:42 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:43.762658 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:43.763636 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:43.770096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:43.770535 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:43.771278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:43.771703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:43.855208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bd20ebc5-d7df-41e2-b8da-1b3e0106269f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.096428 Sep 23 03:25:43.855860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 599/1210] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:43 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:44.867703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:44.868715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:44.875172 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:44.875612 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:44.876377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:44.876832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:44.959344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-98ccda42-3d24-402f-97ac-5fae8cd05c4a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.095542 Sep 23 03:25:44.960027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 612/1211] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:44 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:25:45.971986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:45.973010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:45.979681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:45.980155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:45.980961 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:45.981394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:46.068779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9b7c6cc2-9d57-468e-8708-4b86a2d57310 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.100631 Sep 23 03:25:46.069410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 600/1212] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:45 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:47.081751 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:47.082661 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:47.089177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:47.089594 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:47.090363 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:47.090797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:47.178642 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a8a33c88-52eb-4e6e-95d4-c6c528223150 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.101621 Sep 23 03:25:47.179286 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 613/1213] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:47 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:25:48.191366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:48.192293 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:48.198669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:48.199102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:48.199843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:48.200270 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:48.282113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6a5723e2-dd3e-4891-81cf-485d936447c5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.095443 Sep 23 03:25:48.282715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 601/1214] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:48 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:49.294668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:49.295694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:49.302771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:49.303213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:49.303976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:49.304409 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:49.385142 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a5dc1a44-c7af-4623-816c-0a844b78be8b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.094167 Sep 23 03:25:49.385756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 614/1215] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:49 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:50.397617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:50.398640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:50.405079 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:50.405529 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:50.406285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:50.406715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:50.495746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-843486fd-28fc-406f-b492-4eaa3fde1d75 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.102608 Sep 23 03:25:50.496359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 602/1216] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:50 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:51.508256 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:51.509275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:51.515710 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:51.516154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:51.516950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:51.517380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:51.600068 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-01551057-efa4-4e36-add5-e57ab2fea65c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.095478 Sep 23 03:25:51.600783 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 615/1217] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:51 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:52.611789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:52.613347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:52.619972 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:52.620406 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:52.621188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:52.621614 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:52.701944 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2ea3d4f7-d6c7-46ad-8d27-d045c70b4a68 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.094079 Sep 23 03:25:52.702556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 603/1218] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:52 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:53.713999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:53.714929 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:53.721394 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:53.722335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:53.723090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:53.723518 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:53.806392 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1912113e-322a-483b-92a7-b29f8c31d46a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.096321 Sep 23 03:25:53.807765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 616/1219] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:53 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:54.818826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:54.819908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:54.826823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:54.827264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:54.828018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:54.828551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:54.921590 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-71d7f38d-0da2-4009-bfe9-ed4d1855e986 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.107094 Sep 23 03:25:54.922211 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 604/1220] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:54 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:55.933581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:55.934574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:55.940981 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:55.941416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:55.942160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:55.942581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:56.032605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-340d57c1-ccce-4ccb-963d-1495a03b13e9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.102807 Sep 23 03:25:56.033489 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 617/1221] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:55 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:57.044569 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:57.045615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:57.051919 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:57.052349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:57.053129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:57.053556 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:57.166042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4a705b8b-5405-47c9-8142-056ee81aa2ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.125284 Sep 23 03:25:57.166749 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 605/1222] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:57 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:58.178861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:58.179753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:58.186310 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:58.186743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:58.187488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:58.187915 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:58.275207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-739dc338-8848-42da-874c-b8585a677a56 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.100833 Sep 23 03:25:58.275835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 618/1223] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:58 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:25:59.286602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:25:59.287594 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:25:59.294045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:59.294485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:59.295243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:25:59.295671 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:25:59.387713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-61846197-3255-4965-bc8b-90ae46224575 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.105062 Sep 23 03:25:59.388323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 606/1224] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:25:59 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:00.400367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:00.401396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:00.407832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:00.408278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:00.409070 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:00.409507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:00.502102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-178e5d19-909b-4ab3-a270-016d8c0fe55e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.105650 Sep 23 03:26:00.503215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 619/1225] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:00 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:01.514658 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:01.515650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:01.522613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:01.523057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:01.523811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:01.524239 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:01.610477 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-81cda43d-1876-4fd4-8a97-c53fd8467500 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.099838 Sep 23 03:26:01.611098 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 607/1226] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:01 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:02.622493 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:02.623487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:02.630397 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:02.630843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:02.631597 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:02.632023 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:02.713212 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-28ecf67f-6c32-4b64-a0e0-0bdf6520a37e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.094656 Sep 23 03:26:02.713825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 620/1227] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:02 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:26:03.725600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:03.726591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:03.733027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:03.733472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:03.734228 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:03.734659 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:03.817087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-01e0a637-50af-4a4c-b17a-b53eaf20c1a0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.095690 Sep 23 03:26:03.819399 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 608/1228] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:03 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:04.829054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:04.830047 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:04.837138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:04.837574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:04.838334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:04.838767 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:04.920476 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a5cfee73-525c-4e91-b0bd-37e55ec41f87 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28675 microversion: 2.1 time: 0.095355 Sep 23 03:26:04.921135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 621/1229] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:04 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28675 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:05.932522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:05.933782 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:05.941248 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:05.941682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:05.942429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:05.942852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:06.048023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-01dad333-1916-489e-83de-6cb72a60f1d4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 28932 microversion: 2.1 time: 0.119363 Sep 23 03:26:06.048669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 609/1230] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:05 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 28932 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:07.059674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:07.060706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:07.067729 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:07.068175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:07.068988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:07.069421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:07.169527 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-826e56f9-e3df-4760-a925-a9ed5655149c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 31156 microversion: 2.1 time: 0.113651 Sep 23 03:26:07.170135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 622/1231] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:07 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 31156 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:08.180943 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:08.181858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:08.188882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:08.189330 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:08.190112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:08.190543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:08.291803 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-20e2499c-823a-45ed-aaa6-771c123e1657 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 32996 microversion: 2.1 time: 0.114905 Sep 23 03:26:08.292762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 610/1232] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:08 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 32996 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:09.304581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:09.305579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:09.311964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:09.312408 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:09.313193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:09.313624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:09.409121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-39d4c47c-2fdb-47b6-9f67-e29aa301bb69 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 34031 microversion: 2.1 time: 0.107695 Sep 23 03:26:09.409990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 623/1233] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:09 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 34031 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:10.421923 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:10.422914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:10.429852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:10.430288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:10.431042 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:10.431470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:10.531669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34a44c7b-7ba9-4cbd-8a87-98af13bcbeb0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 35201 microversion: 2.1 time: 0.113715 Sep 23 03:26:10.532290 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 611/1234] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:10 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 35201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:11.543919 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:11.544967 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:11.551488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:11.551930 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:11.552738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:11.553173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:11.656456 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0188e28a-63ea-4e80-bb7c-b477a6d1b6ea tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 36474 microversion: 2.1 time: 0.116390 Sep 23 03:26:11.657284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 624/1235] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:11 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 36474 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:12.668954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:12.669942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:12.676386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:12.676865 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:12.677619 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:12.678054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:12.769404 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2f0040c4-c611-4588-8446-d11d0cb02e5b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 38042 microversion: 2.1 time: 0.104354 Sep 23 03:26:12.770094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 612/1236] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:12 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 38042 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:26:13.781722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:13.782711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:13.789123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:13.789561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:13.790313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:13.790736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:13.887878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-88fc476f-04bd-4ea1-9354-a0501c89aa7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 38203 microversion: 2.1 time: 0.110014 Sep 23 03:26:13.888553 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 625/1237] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:13 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 38203 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:14.900351 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:14.901325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:14.908390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:14.908861 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:14.909608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:14.910035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:15.014379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5c64e01d-dc12-4eea-8e0d-8f755815dc22 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 38203 microversion: 2.1 time: 0.118273 Sep 23 03:26:15.015031 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 613/1238] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:14 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 38203 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:16.026128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:16.027122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:16.033505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:16.033945 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:16.034736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:16.035168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:16.118424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2685bab9-992e-479d-8311-1277ef7afefc tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 38203 microversion: 2.1 time: 0.096136 Sep 23 03:26:16.118961 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 626/1239] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:16 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 38203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:17.131812 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:17.132737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:17.139142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:17.139577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:17.140317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:17.140775 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:17.233494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c83271fc-1b99-4bde-8bd6-2720833b2a65 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 200 len: 38332 microversion: 2.1 time: 0.106520 Sep 23 03:26:17.234110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 614/1240] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:17 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 38332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:26:17.244637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:17.245204 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:17.251654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:17.252664 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:17.253415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:17.253839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:17.276198 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-31ba878b-1e31-4c69-9da5-7c93f5b32cb2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/ips" status: 200 len: 147 microversion: 2.1 time: 0.035581 Sep 23 03:26:17.276779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 627/1241] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:26:17 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:26:21.113628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d36ea9b-f3e7-4820-ad2f-d2ee994f0781"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:21.114774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:21.121124 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:21.121561 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:21.122307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:21.122730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:21.891849 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cb65a88a-6201-417b-9442-60f75be23001 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782831 Sep 23 03:26:21.892459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 615/1242] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:26:21 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:26:29.394737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-65e0f3af-99cc-41b0-9c55-dbb17e8c4fe6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:29.401079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65e0f3af-99cc-41b0-9c55-dbb17e8c4fe6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:29.401517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-65e0f3af-99cc-41b0-9c55-dbb17e8c4fe6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:29.481181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-65e0f3af-99cc-41b0-9c55-dbb17e8c4fe6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Going to try to stop instance {{(pid=108953) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 23 03:26:29.651231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-65e0f3af-99cc-41b0-9c55-dbb17e8c4fe6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 202 len: 0 microversion: 2.1 time: 0.260091 Sep 23 03:26:29.651748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 628/1243] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:29 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:26:29.661325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:29.667262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:29.668313 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:29.668772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:29.669553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:29.669974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:29.793395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:29.801860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c40d17f7-1afd-4253-8eaa-574c7530e780 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.145544 Sep 23 03:26:29.802425 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 616/1244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:29 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:30.819402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:30.820091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:30.826301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:30.826737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:30.827486 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:30.827910 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:30.947616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:30.955234 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4f40e669-6d46-499c-a34f-84b70d23f1ad tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.139902 Sep 23 03:26:30.955787 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 629/1245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:30 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:31.972110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:31.972753 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:31.979367 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:31.979822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:31.980620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:31.981053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:32.108183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:32.116562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a2e760c0-9d76-4de5-a2fa-c777ccc1bfec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.148136 Sep 23 03:26:32.117243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 617/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:31 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:33.135253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:33.135818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:33.142104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:33.142595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:33.143350 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:33.143778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:33.264292 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:33.272137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4a2aa63c-ff5a-41d7-b9c5-9ed0900842ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.140646 Sep 23 03:26:33.272741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 630/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:33 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:34.289161 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:34.289771 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:34.295523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:34.295967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:34.296745 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:34.297183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:34.416084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:34.427795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-186e4912-bee7-46d9-8d0d-c4b220bb948f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.142326 Sep 23 03:26:34.428394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 618/1248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:34 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:35.445281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:35.445877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:35.451909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:35.452399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:35.453196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:35.453649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:35.575657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:35.584136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d5af777b-402b-46e4-82aa-0aa822c4a8a3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.142503 Sep 23 03:26:35.584740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 631/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:35 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:36.601494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:36.602081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:36.608312 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:36.608786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:36.609543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:36.609976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:36.728587 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:36.736247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-64e9f371-8643-4695-ae06-2fbfa069d7ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.138664 Sep 23 03:26:36.736837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 619/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:36 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:37.753120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:37.753724 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:37.759931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:37.760366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:37.761155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:37.761583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:37.878002 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:37.886015 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c4e89cfb-126c-4421-bb38-03d53e6a9003 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.136568 Sep 23 03:26:37.886606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 632/1251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:37 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:38.902620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:38.903233 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:38.909706 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:38.910143 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:38.910892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:38.911320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:39.027302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:39.035551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-10716031-1a95-4ce0-9833-7e6807a3cb8f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.136604 Sep 23 03:26:39.036114 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 620/1252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:38 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:40.052196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:40.052852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:40.058702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:40.059146 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:40.059901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:40.060329 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:40.179159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:40.186778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2d321bc2-d195-43c1-8c0c-edc9f5939322 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.138282 Sep 23 03:26:40.187335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 633/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:40 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:41.203783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:41.204332 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:41.210700 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:41.211142 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:41.211891 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:41.212320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:41.330838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:41.338430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a1264587-0891-48ae-abf7-e05b923de802 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.138422 Sep 23 03:26:41.338991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 621/1254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:41 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:42.354855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:42.355460 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:42.361933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:42.362362 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:42.363135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:42.363556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:42.480748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:42.489031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d4bcd9cd-e98b-47e6-a07c-68954e481203 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.137801 Sep 23 03:26:42.489600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 634/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:42 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:43.505273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:43.505875 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:43.511641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:43.512080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:43.512858 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:43.513281 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:43.629582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:43.637205 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a1a12fed-3ffb-40a5-a7cc-f9cedc87bd1f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.135570 Sep 23 03:26:43.637761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 622/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:43 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:44.654404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:44.654995 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:44.661380 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:44.661821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:44.662574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:44.662999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:44.786758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:44.794587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-949af810-b3f2-4a5f-81f5-1fa1a1f1db96 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1725 microversion: 2.1 time: 0.143918 Sep 23 03:26:44.795153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 635/1257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:44 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:45.811872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:45.812480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:45.819324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:45.819769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:45.820599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:45.821029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:45.942189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:45.949831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1d55207d-667d-48f0-9bbe-6f8c235c2a30 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1702 microversion: 2.1 time: 0.141516 Sep 23 03:26:45.950394 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 623/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:45 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1702 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:45.970050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e859a93e-373f-49ff-8423-a1cf472c2e7d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:26:45.976806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e859a93e-373f-49ff-8423-a1cf472c2e7d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:45.977192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e859a93e-373f-49ff-8423-a1cf472c2e7d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:46.002985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e859a93e-373f-49ff-8423-a1cf472c2e7d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Going to try to start instance {{(pid=108953) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 23 03:26:46.206003 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e859a93e-373f-49ff-8423-a1cf472c2e7d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 202 len: 0 microversion: 2.1 time: 0.238825 Sep 23 03:26:46.206520 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 636/1259] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:26:45 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:26:46.214516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:46.215436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:46.221510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:46.221954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:46.222721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:46.223154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:46.346890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:46.354944 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ec1eac24-7ea4-4373-9cfc-6c3a65d1a399 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1711 microversion: 2.1 time: 0.144159 Sep 23 03:26:46.355512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 624/1260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:46 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1711 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:47.372905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:47.373588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:47.380082 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:47.380525 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:47.381297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:47.381719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:47.503057 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:47.511499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-16ca92b6-2ecc-42db-bd9b-68433dc68bba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1711 microversion: 2.1 time: 0.142744 Sep 23 03:26:47.512424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 637/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:47 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1711 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:48.528714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:26:48.529318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:26:48.535782 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:48.536227 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:48.537006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:26:48.537439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:26:48.654225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:26:48.662512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-72744656-13f5-400a-b218-074a03861213 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1715 microversion: 2.1 time: 0.137446 Sep 23 03:26:48.663071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 625/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:26:48 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1715 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:26:57.719765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:26:57.720932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:26:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:27:05.864855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:05.865508 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:05.872213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:05.872681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:05.873804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:05.874623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:05.901162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:27:05.995952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-277e3ec9-8727-4c2f-9042-0e9caaf7d412 req-70143555-97af-444f-96a6-833dcfe2a288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:27:05.997963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:27:05.997963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:27:06.005520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-277e3ec9-8727-4c2f-9042-0e9caaf7d412 req-70143555-97af-444f-96a6-833dcfe2a288 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:06.005963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-277e3ec9-8727-4c2f-9042-0e9caaf7d412 req-70143555-97af-444f-96a6-833dcfe2a288 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:06.025712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-277e3ec9-8727-4c2f-9042-0e9caaf7d412 req-70143555-97af-444f-96a6-833dcfe2a288 service nova] Creating event network-changed:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:27:06.031221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-277e3ec9-8727-4c2f-9042-0e9caaf7d412 req-70143555-97af-444f-96a6-833dcfe2a288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167590 Sep 23 03:27:06.032023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 626/1263] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:27:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:27:06.276739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4183e242-d228-4746-8ab2-d062c04e4b2a tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 204 len: 0 microversion: 2.1 time: 0.416212 Sep 23 03:27:06.278740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 638/1264] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:27:05 2021] DELETE /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:27:06.287190 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:06.288003 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:06.294827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:06.295367 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:06.296230 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:06.296752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:06.430402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:06.438180 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6f6557a5-28af-4485-ae16-d90c15e55136 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1569 microversion: 2.1 time: 0.155839 Sep 23 03:27:06.439097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 627/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:06 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:07.456129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:07.456863 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:07.462765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:07.463203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:07.463956 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:07.464381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:07.585284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:07.592418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cb20d12d-905d-43cb-939a-c59f1efbbf5f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1451 microversion: 2.1 time: 0.140875 Sep 23 03:27:07.593014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 639/1266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:07 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:08.609816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:08.610356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:08.616637 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:08.617074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:08.617821 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:08.618245 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:08.736681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:08.744894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cc249d50-4c28-4456-95fa-326446bae94f tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1451 microversion: 2.1 time: 0.138676 Sep 23 03:27:08.745465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 628/1267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:08 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1451 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:08.829569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-017b5f94-34dd-4679-be4e-163a3457c628 req-41272b60-b344-41ce-851f-c3ffe54cff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbba714-1d40-419f-865c-d0346b7ac67e", "name": "network-vif-deleted", "tag": "1f26003b-9eee-40b2-af89-d9caf3eb8eda"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:27:08.831588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:27:08.831588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:27:08.838301 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-017b5f94-34dd-4679-be4e-163a3457c628 req-41272b60-b344-41ce-851f-c3ffe54cff71 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:08.844405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-017b5f94-34dd-4679-be4e-163a3457c628 req-41272b60-b344-41ce-851f-c3ffe54cff71 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:08.851007 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-017b5f94-34dd-4679-be4e-163a3457c628 req-41272b60-b344-41ce-851f-c3ffe54cff71 service nova] Creating event network-vif-deleted:1f26003b-9eee-40b2-af89-d9caf3eb8eda for instance 9fbba714-1d40-419f-865c-d0346b7ac67e on hv-cinder-76845 Sep 23 03:27:08.855868 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-017b5f94-34dd-4679-be4e-163a3457c628 req-41272b60-b344-41ce-851f-c3ffe54cff71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029899 Sep 23 03:27:08.856510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 640/1268] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:27:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:27:09.761952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:09.762503 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:09.768164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:09.792308 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:09.792308 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:09.792308 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:09.829495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:09.837152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b9b6746f-f0e2-46d9-87b6-176d6e97a225 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1220 microversion: 2.1 time: 0.079077 Sep 23 03:27:09.837722 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 629/1269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:09 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:10.854715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:10.855399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:10.861654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:10.862087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:10.862936 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:10.863360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:10.893261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:10.893694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:10.894130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.objects.instance [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lazy-loading 'fault' on Instance uuid 9fbba714-1d40-419f-865c-d0346b7ac67e {{(pid=108953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:27:10.932625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083df39fb8c475ab468e84c6134c764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9295094fe94cc69e88db5d29658b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:10.939855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0a83a876-ac99-4bdd-a0b4-bee6a51f7297 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 200 len: 1225 microversion: 2.1 time: 0.089517 Sep 23 03:27:10.945743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 641/1270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:10 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:11.956615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:11.957228 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] [instance: 9fbba714-1d40-419f-865c-d0346b7ac67e] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:11.963076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:11.963519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:11.964264 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:11.964718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:11.977824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] HTTP exception thrown: Instance 9fbba714-1d40-419f-865c-d0346b7ac67e could not be found. Sep 23 03:27:11.978397 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Returning 404 to user: Instance 9fbba714-1d40-419f-865c-d0346b7ac67e could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:27:11.979197 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4e0090fe-8c69-4e2b-a61e-7acca9037681 tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e" status: 404 len: 111 microversion: 2.1 time: 0.026242 Sep 23 03:27:11.979703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 630/1271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:11 2021] GET /compute/v2.1/servers/9fbba714-1d40-419f-865c-d0346b7ac67e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:27:12.223364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-28a6b3c3-82bd-4d92-8af4-be396edac5ac tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] Calling method '.version_select at 0x7fd1b4106670>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:12.299999 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-28a6b3c3-82bd-4d92-8af4-be396edac5ac tempest-TestShelveInstance-1976416560 tempest-TestShelveInstance-1976416560-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1629492020" status: 202 len: 0 microversion: 2.1 time: 0.080434 Sep 23 03:27:12.300600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 642/1272] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Sep 23 03:27:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1629492020 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:27:44.116890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:44.117472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:44.123096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:44.123539 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:44.124289 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:44.124747 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:44.206159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lazy-loading 'services' on Instance uuid db993b7a-3b47-46ed-846f-75a26878be5b {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:27:44.397197 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-98685217-8905-4d04-aa4f-9d0a1663672d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments/3d36ea9b-f3e7-4820-ad2f-d2ee994f0781" status: 202 len: 0 microversion: 2.1 time: 0.284097 Sep 23 03:27:44.397712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 631/1273] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:27:44 2021] DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments/3d36ea9b-f3e7-4820-ad2f-d2ee994f0781 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:27:45.524862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-368c42a4-5564-4b82-a40d-62fa88c27eb8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:27:45.530709 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-368c42a4-5564-4b82-a40d-62fa88c27eb8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:45.531140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-368c42a4-5564-4b82-a40d-62fa88c27eb8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:45.554360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-368c42a4-5564-4b82-a40d-62fa88c27eb8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Going to try to stop instance {{(pid=108953) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 23 03:27:45.760174 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-368c42a4-5564-4b82-a40d-62fa88c27eb8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 202 len: 0 microversion: 2.1 time: 0.240055 Sep 23 03:27:45.760803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 643/1274] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:27:45 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:27:45.769000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:45.772698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:45.776251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:45.776728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:45.777550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:45.777914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:45.898506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:45.905789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8713c713-6ea3-41be-8705-23a3c7eb1f51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.140783 Sep 23 03:27:45.906346 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 632/1275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:45 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:46.923365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:46.924049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:46.930621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:46.931056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:46.931804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:46.932225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:47.058503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:47.065854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-36128f1a-aade-421a-96c1-b3d06dbe9c60 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.146797 Sep 23 03:27:47.066415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 644/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:46 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:27:48.083030 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:48.083568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:48.089531 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:48.089967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:48.090714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:48.091140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:48.207516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:48.214734 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2ba2b2e7-b43e-4434-bb78-3a73dd471178 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.135533 Sep 23 03:27:48.215291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 633/1277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:48 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:49.232072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:49.232639 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:49.238521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:49.238960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:49.240227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:49.240687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:49.356183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:49.363438 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7d79a455-249b-4640-9056-0707eabd905a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.135109 Sep 23 03:27:49.364009 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 645/1278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:49 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:50.380978 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:50.381586 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:50.387411 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:50.387883 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:50.388666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:50.389113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:50.515908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:50.523579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f0f58c88-448d-43a0-9ed4-1ba94d85e7be tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.146778 Sep 23 03:27:50.524156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 634/1279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:50 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:51.540141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:51.540844 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:51.551356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:51.551356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:51.551356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:51.551356 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:51.670837 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:51.678606 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3e1e45b3-3cf0-443b-8df5-5bad0a476873 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.142109 Sep 23 03:27:51.679164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 646/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:51 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:52.695880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:52.696505 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:52.702207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:52.702648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:52.703401 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:52.703831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:52.820846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:52.828140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-755b74b6-177e-403d-a26f-fab57a82c19d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.136508 Sep 23 03:27:52.828728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 635/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:52 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:53.845814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:53.846429 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:53.853152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:53.853598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:53.854360 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:53.854791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:53.970122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:53.978170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-978424fc-bb31-4ec6-a090-124415e27e98 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.136061 Sep 23 03:27:53.978729 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 647/1282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:53 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:54.994695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:54.995244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:55.001081 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:55.001528 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:55.002288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:55.002721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:55.121994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:55.132199 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-59c2ac47-f1d8-4530-b726-15a93b79c363 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.141226 Sep 23 03:27:55.138676 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 636/1283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:54 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:56.149411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:56.149953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:56.155692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:56.156128 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:56.156907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:56.157335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:56.286357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:56.286357 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fd2674e2-b5e1-470d-9533-800187be5a6f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1679 microversion: 2.1 time: 0.140057 Sep 23 03:27:56.286694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 648/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:56 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:57.303127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:57.303738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:57.309532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:57.309976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:57.310734 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:57.311167 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:57.624383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:57.631575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-f94ac8b1-6788-46e5-8460-984503cd035c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1656 microversion: 2.1 time: 0.332613 Sep 23 03:27:57.632130 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 637/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:57 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1656 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:57.648141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-55a96f1d-87f2-4de3-a781-f93bc90865d3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:27:57.654505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55a96f1d-87f2-4de3-a781-f93bc90865d3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:57.654945 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55a96f1d-87f2-4de3-a781-f93bc90865d3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:57.676735 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-55a96f1d-87f2-4de3-a781-f93bc90865d3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Going to try to start instance {{(pid=108953) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 23 03:27:57.840678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-55a96f1d-87f2-4de3-a781-f93bc90865d3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action" status: 202 len: 0 microversion: 2.1 time: 0.196451 Sep 23 03:27:57.841284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 649/1286] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:27:57 2021] POST /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 03:27:57.855089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:57.855696 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:57.861410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:57.861872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:57.862605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:57.863029 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:57.945648 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:27:57.946006 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:27:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:27:57.983186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:57.991703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c769e38b-c105-4d41-a965-a355b2b909ec tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1665 microversion: 2.1 time: 0.140252 Sep 23 03:27:57.992287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 638/1287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:57 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:27:59.009477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:27:59.010179 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:27:59.016312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:59.016818 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:59.017588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:27:59.018019 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:27:59.199235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:27:59.206467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1f03a55c-4839-4a7a-b8db-556509142cf4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1665 microversion: 2.1 time: 0.201049 Sep 23 03:27:59.210400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 650/1288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:27:59 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:28:00.224439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:28:00.225016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:28:00.230829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:28:00.231273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:28:00.232033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:28:00.232466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:28:00.360045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:28:00.367807 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6f878ff6-88ac-42a2-ae80-79a33584b991 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1669 microversion: 2.1 time: 0.147936 Sep 23 03:28:00.368368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 639/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:28:00 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:03.530090 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:03.531005 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:03.537815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.538257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:03.539025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.539497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:03.567777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a6d295d2-2b6e-4151-9b18-7c1491006b17 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043306 Sep 23 03:29:03.568325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 651/1290] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:29:03 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:03.626919 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 03:29:03.630826 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:03.631314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:03.637069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.637507 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:03.638252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.638678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:03.663516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:29:03.954466 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e51b7953-d063-4b12-b72e-80a2923bbee4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 204 len: 0 microversion: 2.1 time: 0.328998 Sep 23 03:29:03.955084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 640/1291] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:29:03 2021] DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:29:03.963124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:03.963739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:03.969762 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.970463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:03.971227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:03.971663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:04.090316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:04.097745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-25f12cb2-0380-410b-b8df-fb43df595b55 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1675 microversion: 2.1 time: 0.138283 Sep 23 03:29:04.098303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 652/1292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:03 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:05.116305 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:05.116968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:05.134196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:05.134665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:05.135423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:05.135860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:05.141763 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35552. Sep 23 03:29:05.266934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:05.274150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-69a8b9e8-801f-4095-a055-03d7489fe0a9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1675 microversion: 2.1 time: 0.162588 Sep 23 03:29:05.274709 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 641/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:05 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:06.291810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:06.292427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:06.298161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:06.299942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:06.299942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:06.299942 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:06.482073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:06.490598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-00189746-27c2-447d-a52b-2aec60953459 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1675 microversion: 2.1 time: 0.202493 Sep 23 03:29:06.491163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 653/1294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:06 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:07.476762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-01ef4d11-52a0-413a-95ff-626e5a5c044d req-e93aa8f6-0a9d-4632-bc53-e5762b10e642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db993b7a-3b47-46ed-846f-75a26878be5b", "name": "network-vif-deleted", "tag": "fb38e51e-efa4-4206-a272-d5b4cb1b046e"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:07.478276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:29:07.478276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:29:07.485220 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-01ef4d11-52a0-413a-95ff-626e5a5c044d req-e93aa8f6-0a9d-4632-bc53-e5762b10e642 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:07.486408 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-01ef4d11-52a0-413a-95ff-626e5a5c044d req-e93aa8f6-0a9d-4632-bc53-e5762b10e642 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:07.498378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-01ef4d11-52a0-413a-95ff-626e5a5c044d req-e93aa8f6-0a9d-4632-bc53-e5762b10e642 service nova] Creating event network-vif-deleted:fb38e51e-efa4-4206-a272-d5b4cb1b046e for instance db993b7a-3b47-46ed-846f-75a26878be5b on hv-cinder-76845 Sep 23 03:29:07.503716 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-01ef4d11-52a0-413a-95ff-626e5a5c044d req-e93aa8f6-0a9d-4632-bc53-e5762b10e642 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 Sep 23 03:29:07.504457 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 642/1295] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:29:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:07.508078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:07.508682 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:07.514869 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:07.515315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:07.516085 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:07.516690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:07.587057 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:07.593870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-10300b7f-6bbd-4f92-b5f9-3cafcd38621f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 200 len: 1607 microversion: 2.1 time: 0.090381 Sep 23 03:29:07.602529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 654/1296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:07 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:29:08.615817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:08.617258 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:08.623949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:08.624607 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:08.625758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:08.626327 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:08.646918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. Sep 23 03:29:08.647675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:29:08.648764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-579dbb54-3a04-4e2d-bfd7-5dc87f4f04d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 404 len: 111 microversion: 2.1 time: 0.040557 Sep 23 03:29:08.649420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 643/1297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:08 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:29:08.657804 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-065967be-ae04-42d0-aafb-d03d69f2db48 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '.version_select at 0x7fd1b40f5ca0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:08.744477 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-065967be-ae04-42d0-aafb-d03d69f2db48 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072528115" status: 202 len: 0 microversion: 2.1 time: 0.090421 Sep 23 03:29:08.745072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 655/1298] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Sep 23 03:29:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072528115 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:29:09.548127 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: .version_select at 0x7fd1b4103f70>, body: {"keypair": {"name": "tempest-keypair-1939143316"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:09.566695 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:29:09.571426 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:29:10.167237 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:29:10.170834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:29:10.184016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bca25f8d-c699-47d1-acd3-3f905f804900 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.642390 Sep 23 03:29:10.184627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 644/1299] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Sep 23 03:29:09 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:12.546223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1336060769", "imageRef": "ba4b3434-cfb6-4227-8d33-f0a48a59ede7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b92c029f-810f-4549-a812-649ee96dc75b"}], "security_groups": [{"name": "tempest-securitygroup--1804949631"}], "key_name": "tempest-keypair-1939143316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:12.638586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] validate_networks() for [('b92c029f-810f-4549-a812-649ee96dc75b', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:29:13.055569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:29:13.055986 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:29:13.056453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:29:13.056975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:29:13.057384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:29:13.066227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:13.066655 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:13.067467 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:13.067885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:13.084008 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for project 976c473ab2634adaa47c36dca50bf392. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:29:13.088249 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Getting quotas for user 2700498241084d4aa4099e8034fbeb94 and project 976c473ab2634adaa47c36dca50bf392. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:29:13.099574 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:29:13.101908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba4b3434-cfb6-4227-8d33-f0a48a59ede7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:29:13.203933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1e5377e2-ecd1-4d73-b2b7-ffb49befd0ba tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661664 Sep 23 03:29:13.204601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 656/1300] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:29:12 2021] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:29:13.214816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e91cf8b3-fede-47e7-bd5c-1c48792bfb01 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:13.215427 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e91cf8b3-fede-47e7-bd5c-1c48792bfb01 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:13.268217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e91cf8b3-fede-47e7-bd5c-1c48792bfb01 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:13.275892 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e91cf8b3-fede-47e7-bd5c-1c48792bfb01 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1238 microversion: 2.1 time: 0.064755 Sep 23 03:29:13.276445 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 645/1301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:13 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:14.292889 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:14.293496 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:14.299313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:14.299749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:14.300510 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:14.300959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:14.359596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:14.367207 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bab754e6-726f-43bc-ae8a-e76031b85659 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1242 microversion: 2.1 time: 0.078011 Sep 23 03:29:14.369684 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 657/1302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:14 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:15.383262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:15.383863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:15.389682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:15.390112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:15.390863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:15.391286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:15.450159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:15.458025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4441a194-47be-4fc8-97a4-549770ff97b0 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1298 microversion: 2.1 time: 0.078012 Sep 23 03:29:15.458603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 646/1303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:15 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1298 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:29:16.475186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:16.475794 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:16.481629 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:16.482073 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:16.482827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:16.483261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:16.681854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:16.688931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3aad7943-27bb-4ff1-b628-6aead5641fb9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.217363 Sep 23 03:29:16.689499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 658/1304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:16 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:17.185999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-5a8d1b1f-d7f7-4de6-ace0-b2ac57e50317 req-faff4812-88a9-4414-a8e1-3239f11437fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3", "tag": "872b4157-921c-4c03-bc0d-7b7a7f08a05d"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:17.185999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:29:17.185999 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:29:17.189934 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-5a8d1b1f-d7f7-4de6-ace0-b2ac57e50317 req-faff4812-88a9-4414-a8e1-3239f11437fd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:17.190370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-5a8d1b1f-d7f7-4de6-ace0-b2ac57e50317 req-faff4812-88a9-4414-a8e1-3239f11437fd service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:17.203837 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-5a8d1b1f-d7f7-4de6-ace0-b2ac57e50317 req-faff4812-88a9-4414-a8e1-3239f11437fd service nova] Creating event network-changed:872b4157-921c-4c03-bc0d-7b7a7f08a05d for instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 on hv-cinder-76845 Sep 23 03:29:17.209378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-5a8d1b1f-d7f7-4de6-ace0-b2ac57e50317 req-faff4812-88a9-4414-a8e1-3239f11437fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034305 Sep 23 03:29:17.210388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 647/1305] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:17.705558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:17.706290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:17.712136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:17.712608 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:17.713379 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:17.713811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:17.916634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:17.923909 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1329a5fa-7023-47fb-9a1c-f189c49d66b8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.222075 Sep 23 03:29:17.924530 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 659/1306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:17 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:18.941362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:18.942549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:18.948593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:18.949033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:18.949778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:18.950201 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:19.073630 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:19.080839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c62e90ff-2941-4743-8793-7f64d7740800 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.143394 Sep 23 03:29:19.081786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 648/1307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:18 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:20.098561 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:20.099135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:20.105017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:20.105458 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:20.106213 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:20.106643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:20.231297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:20.238566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-567809c2-b63b-4e75-8ff5-36509d000524 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.144087 Sep 23 03:29:20.239628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 660/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:20 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:21.255721 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:21.256561 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:21.262832 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:21.263267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:21.264020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:21.264442 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:21.382839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:21.390012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-851dd59c-75f0-4176-b45a-9137ed490bfa tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.138730 Sep 23 03:29:21.390570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 649/1309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:21 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:22.407107 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:22.407711 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:22.413537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:22.413975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:22.414730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:22.415160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:22.537312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:22.546027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c07b321f-09c9-45c6-bb05-7024fec29ceb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.142522 Sep 23 03:29:22.546599 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 661/1310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:22 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:23.563444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:23.564126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:23.570445 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:23.570898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:23.571642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:23.572070 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:23.704448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:23.704448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-016c4526-0420-4177-aa2b-ccd0e7424e59 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.138063 Sep 23 03:29:23.704448 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 650/1311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:23 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:23.869771 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-fe50825f-283d-437b-86d2-e4304744da01 req-130ed526-c762-431d-82eb-cbd0955b3c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3", "name": "network-vif-plugged", "status": "completed", "tag": "872b4157-921c-4c03-bc0d-7b7a7f08a05d"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:23.871388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:29:23.871388 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:29:23.878288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fe50825f-283d-437b-86d2-e4304744da01 req-130ed526-c762-431d-82eb-cbd0955b3c79 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:23.878730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fe50825f-283d-437b-86d2-e4304744da01 req-130ed526-c762-431d-82eb-cbd0955b3c79 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:23.890364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-fe50825f-283d-437b-86d2-e4304744da01 req-130ed526-c762-431d-82eb-cbd0955b3c79 service nova] Creating event network-vif-plugged:872b4157-921c-4c03-bc0d-7b7a7f08a05d for instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 on hv-cinder-76845 Sep 23 03:29:23.896537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-fe50825f-283d-437b-86d2-e4304744da01 req-130ed526-c762-431d-82eb-cbd0955b3c79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Sep 23 03:29:23.897154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 662/1312] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:24.714502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:24.715106 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:24.721112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:24.721554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:24.722336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:24.722742 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:24.846453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:24.854115 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-80dd0566-73b0-4cab-ab1d-fa23263bbb21 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1364 microversion: 2.1 time: 0.143347 Sep 23 03:29:24.854677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 651/1313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:24 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:25.871054 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:25.871740 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:25.877858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:25.878283 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:25.879051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:25.879643 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:26.002132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:29:26.009348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bf64297b-3276-4d43-9022-0aa0e762d7da tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1551 microversion: 2.1 time: 0.142339 Sep 23 03:29:26.009905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 663/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:29:25 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1551 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:26.025497 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:29:26.025998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:26.031559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:26.031998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:26.032769 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:26.033191 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:26.110513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-caf8a82a-7e83-419c-a538-bc1479e30fca tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088618 Sep 23 03:29:26.111094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 652/1315] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Sep 23 03:29:26 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:27.299907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:27.300855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:27.307760 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-d3fcbeb7-92d8-4322-84b6-3cb6fd0ac906 req-2983348a-db06-413d-b54c-aad8c027def0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3", "tag": "872b4157-921c-4c03-bc0d-7b7a7f08a05d"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:27.309331 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:27.309852 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:27.310267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:29:27.310267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:29:27.311078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:27.311589 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:27.319160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d3fcbeb7-92d8-4322-84b6-3cb6fd0ac906 req-2983348a-db06-413d-b54c-aad8c027def0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:27.319953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d3fcbeb7-92d8-4322-84b6-3cb6fd0ac906 req-2983348a-db06-413d-b54c-aad8c027def0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:27.331071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-d3fcbeb7-92d8-4322-84b6-3cb6fd0ac906 req-2983348a-db06-413d-b54c-aad8c027def0 service nova] Creating event network-changed:872b4157-921c-4c03-bc0d-7b7a7f08a05d for instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 on hv-cinder-76845 Sep 23 03:29:27.336304 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-d3fcbeb7-92d8-4322-84b6-3cb6fd0ac906 req-2983348a-db06-413d-b54c-aad8c027def0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032060 Sep 23 03:29:27.337337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 653/1316] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:29:27.422765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-efc21967-2dd5-4efd-8df7-ab42237f2bda tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.123443 Sep 23 03:29:27.422765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 664/1317] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:27 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:28.436513 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:28.437525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:28.444390 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:28.444874 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:28.445637 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:28.446089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:28.524563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8597d790-7187-4458-80aa-a7cd79a865cb tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.096382 Sep 23 03:29:28.525386 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 654/1318] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:28 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 03:29:29.536412 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:29.537521 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:29.544026 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:29.547988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:29.547988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:29.547988 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:29.623596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c9c608df-7b4e-4edf-8a03-eeb698441471 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.091205 Sep 23 03:29:29.624193 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 665/1319] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:29 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:30.634991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:30.635976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:30.642443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:30.642884 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:30.643639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:30.644067 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:30.722620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1a5829d0-dd14-40ed-9f70-adb3ca124212 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.091625 Sep 23 03:29:30.723784 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 655/1320] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:30 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:31.734633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:31.735613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:31.742708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:31.743148 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:31.743907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:31.744335 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:31.825704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0e080c21-ecf7-431c-9f76-86fe04503ae6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.094991 Sep 23 03:29:31.826374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 666/1321] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:31 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:32.838094 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:32.839074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:32.845751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:32.846192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:32.846933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:32.847356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:32.932915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-db41190f-d9b3-470e-8e4a-e9770ba78537 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.098596 Sep 23 03:29:32.934025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 656/1322] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:32 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:33.944274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:33.945290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:33.951756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:33.952194 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:33.952985 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:33.953415 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:34.031741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-17aa976f-d785-41dc-ba17-0c21c612efe8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.091404 Sep 23 03:29:34.032349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 667/1323] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:33 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:35.043072 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:35.044101 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:35.051009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:35.051460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:35.052213 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:35.052675 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:35.130813 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4a4a3e5d-8820-40ae-b902-982fb79f9355 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.091614 Sep 23 03:29:35.131324 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 657/1324] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:35 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:36.142229 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:36.143152 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:36.149770 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:36.150219 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:36.150989 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:36.151424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:36.237024 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-21d5d66f-04b1-49cd-8efb-4a35beb220a6 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 14 microversion: 2.1 time: 0.098800 Sep 23 03:29:36.237637 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 668/1325] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:36 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:29:37.249093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:37.250093 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:37.257240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:37.257685 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:37.258446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:37.258876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:37.344195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3cf564ed-3f40-4a98-9f39-2883ef710d53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 3533 microversion: 2.1 time: 0.099033 Sep 23 03:29:37.345009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 658/1326] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:37 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 3533 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:29:38.412617 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:38.413667 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:38.419708 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:38.420153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:38.420944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:38.421377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:38.508208 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-82e49026-ccca-401c-a29a-973e813fc251 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 15025 microversion: 2.1 time: 0.155671 Sep 23 03:29:38.508832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 669/1327] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:38 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 15025 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:39.519789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:39.520741 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:39.527137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:39.527575 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:39.528357 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:39.528829 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:39.624920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0b7abdc5-9270-4436-9f40-719aa38f5a89 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 18498 microversion: 2.1 time: 0.109089 Sep 23 03:29:39.625524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 659/1328] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:39 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 18498 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:40.636929 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:40.637920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:40.644337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:40.644801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:40.645557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:40.645983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:40.739197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e6e9df7b-ddbf-4020-ad21-c47197f43c99 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 19446 microversion: 2.1 time: 0.106153 Sep 23 03:29:40.740044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 670/1329] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:40 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 19446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:41.751083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:41.752068 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:41.759253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:41.759688 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:41.760436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:41.760885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:41.846012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-389c2e9e-b6cd-428f-b22e-b79288f63e1d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 22540 microversion: 2.1 time: 0.098767 Sep 23 03:29:41.846680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 660/1330] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:41 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 22540 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:42.857821 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:42.858815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:42.865320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:42.865760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:42.866516 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:42.866947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:42.952140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-7d853193-42c9-4283-8ec5-54f0cac163d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 23879 microversion: 2.1 time: 0.098221 Sep 23 03:29:42.952786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 671/1331] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:42 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 23879 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:43.963992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:43.965015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:43.971799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:43.972854 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:43.973617 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:43.974051 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:44.069225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ee98ccb5-cb7c-4f62-9a5f-763bc7f4ee7c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 25854 microversion: 2.1 time: 0.109108 Sep 23 03:29:44.069827 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 661/1332] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:43 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 25854 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:45.081191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:45.082119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:45.088579 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:45.089029 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:45.089790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:45.090222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:45.202031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1158abcf-ef10-428e-9ab2-f0bfb8026ba5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 27130 microversion: 2.1 time: 0.124884 Sep 23 03:29:45.202657 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 672/1333] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:45 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 27130 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:46.214053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:46.215035 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:46.221842 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:46.222318 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:46.223077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:46.223510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:46.320341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-22e988f7-95dd-4156-93f8-1d816356e27b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 27704 microversion: 2.1 time: 0.110273 Sep 23 03:29:46.321038 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 662/1334] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:46 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 27704 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:47.333080 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:47.334074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:47.340558 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:47.340997 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:47.341747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:47.342169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:47.433493 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5fdf6a43-ee67-4168-8a02-2fdf12203b83 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28115 microversion: 2.1 time: 0.104943 Sep 23 03:29:47.434118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 673/1335] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:47 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28115 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:48.445527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:48.446519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:48.452932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:48.453371 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:48.454122 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:48.454548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:48.550218 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4e22b4ea-d102-489a-8719-d77c2c4de795 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.108625 Sep 23 03:29:48.550869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 663/1336] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:48 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:49.562325 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:49.563313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:49.570480 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:49.570920 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:49.571689 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:49.572120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:49.651466 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ac25c8d6-e199-4459-bf7c-41dbe4fd235f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.093087 Sep 23 03:29:49.652075 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 674/1337] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:49 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:50.663520 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:50.664527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:50.670956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:50.671396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:50.672147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:50.672610 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:50.765615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-875b61de-dd54-4f68-9e34-09ed2b8c51cd tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.105966 Sep 23 03:29:50.766262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 664/1338] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:50 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:51.777624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:51.778544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:51.785706 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:51.786147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:51.786905 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:51.787334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:51.867432 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f2dcd6ae-d66a-451d-aa6f-af877220b2a1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.093728 Sep 23 03:29:51.868065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 675/1339] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:51 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:52.879776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:52.880824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:52.887269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:52.887730 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:52.888510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:52.888950 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:52.969443 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4cc9e9d3-2ed5-4265-bbb3-16aafcf2a7d5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.093842 Sep 23 03:29:52.970504 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 665/1340] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:52 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:53.981072 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:53.982059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:53.988972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:53.989411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:53.990170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:53.990596 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:54.085575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c752626e-eb97-4247-8ae9-dab08ee4da52 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.108363 Sep 23 03:29:54.086116 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 676/1341] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:53 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:55.098104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:55.099113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:55.105447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:55.105882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:55.106662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:55.107086 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:55.188820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4930b1a3-8731-428d-b7b1-719d77c4a617 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.095041 Sep 23 03:29:55.189435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 666/1342] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:55 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:56.200879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:56.201826 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:56.208262 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:56.215542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:56.215542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:56.215542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:56.290279 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-33931c6d-1008-4884-9579-292504f250d1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.093375 Sep 23 03:29:56.290955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 677/1343] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:56 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:29:57.303057 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:57.304044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:57.310375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:57.310809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:57.311560 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:57.311986 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:57.399519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c28e67d7-0b1a-4aaf-98e8-ecec896b79e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.100770 Sep 23 03:29:57.400053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 667/1344] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:57 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:29:58.412137 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:58.413197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:58.419681 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:58.420113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:58.420911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:58.421344 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:58.507903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-fbb44de5-e6aa-4029-a2b3-47cdb69f33ed tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.100359 Sep 23 03:29:58.508539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 678/1345] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:58 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:29:59.519941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:29:59.520959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:29:59.527337 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:59.528672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:59.528672 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:29:59.528941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:29:59.617080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9337c646-2b79-4cca-b730-bfe6ca0dde53 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28232 microversion: 2.1 time: 0.100972 Sep 23 03:29:59.617965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 668/1346] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:29:59 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28232 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:00.629575 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:00.630569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:00.637036 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:00.637471 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:00.638226 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:00.638652 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:00.727447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0cf0672a-eaa8-4067-8f0f-abce3d227c1b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28523 microversion: 2.1 time: 0.102321 Sep 23 03:30:00.728381 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 679/1347] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:00 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28523 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:01.739510 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:01.740512 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:01.746873 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:01.747286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:01.748031 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:01.748455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:01.845724 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-a808a433-24c1-4c59-baa6-aeed88e47b45 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.110066 Sep 23 03:30:01.846364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 669/1348] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:01 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:02.860614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:02.861616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:02.868245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:02.868722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:02.869492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:02.869922 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:02.956685 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f5c72cb8-7c46-4b15-bcd5-5d356e023a7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.099524 Sep 23 03:30:02.957361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 680/1349] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:02 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:03.968627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:03.969871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:03.976814 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:03.977261 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:03.978016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:03.978444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:04.061545 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-84d43d4c-3574-4b8d-8f64-ccadb5fb6034 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.096840 Sep 23 03:30:04.062144 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 670/1350] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:03 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:05.073719 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:05.074636 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:05.081645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:05.082079 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:05.082824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:05.083246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:05.168303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3fd67b8d-32f1-4173-9402-fefd212d7205 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.098526 Sep 23 03:30:05.169032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 681/1351] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:05 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:30:06.181235 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:06.182131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:06.188475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:06.188939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:06.189678 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:06.190100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:06.279983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-90d4701b-ee6a-4b8b-a5d4-a755dffc1f82 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.102738 Sep 23 03:30:06.280652 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 671/1352] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:06 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:07.291815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:07.292856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:07.299808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:07.300245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:07.301030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:07.301490 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:07.380712 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c04d0e71-8554-4296-8306-d6cc1d0ab256 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.092784 Sep 23 03:30:07.381247 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 682/1353] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:07 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:08.392654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:08.394169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:08.400596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:08.401043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:08.401799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:08.402228 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:08.486915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34e5f335-b58d-4948-ba29-fe2783332c13 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.098208 Sep 23 03:30:08.487519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 672/1354] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:08 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:09.500545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:09.501802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:09.508923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:09.509361 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:09.510122 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:09.510549 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:09.593979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-36363162-40eb-4194-8a48-4c97aad77302 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.098006 Sep 23 03:30:09.594626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 683/1355] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:09 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:10.606083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:10.607097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:10.614008 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:10.614455 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:10.615208 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:10.615641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:10.708294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1d3a7282-ff44-46bd-9326-f4c663d93b7e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.106140 Sep 23 03:30:10.708932 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 673/1356] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:10 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:11.720482 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:11.722097 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:11.728542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:11.728990 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:11.729760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:11.730190 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:11.820005 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bc413e62-d54b-4876-ad9f-b1d1808b89a7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.103699 Sep 23 03:30:11.820939 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 684/1357] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:11 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:12.831623 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:12.832654 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:12.839136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:12.839634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:12.840398 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:12.840937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:12.927537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-54f3e90c-065b-41ee-90bb-9bd4027401a2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.099749 Sep 23 03:30:12.928179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 674/1358] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:12 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:13.939824 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:13.940884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:13.947391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:13.947833 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:13.948621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:13.949049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:14.034159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-81ff91ff-7714-47d4-9f6c-8f7a1ede72f5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.098289 Sep 23 03:30:14.034789 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 685/1359] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:13 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:15.046162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:15.047186 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:15.054158 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:15.054601 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:15.055355 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:15.055783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:15.134688 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-18117ce7-a85e-40a3-bc22-c66b1971b0c7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.092397 Sep 23 03:30:15.135226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 675/1360] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:15 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:30:16.146921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:16.147858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:16.154237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:16.154673 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:16.155421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:16.155850 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:16.241731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-19024484-91b2-413f-aec3-e41628e2dced tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.098844 Sep 23 03:30:16.242389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 686/1361] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:16 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:17.253889 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:17.254790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:17.261217 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:17.261661 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:17.262414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:17.262843 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:17.351582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-39837afb-bac5-4b50-a022-30dd78955b7b tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.102199 Sep 23 03:30:17.352195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 676/1362] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:17 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:18.364117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:18.365192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:18.371632 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:18.372074 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:18.372858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:18.373282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:18.456645 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3d48ba9c-df53-4d79-9c1e-d37f6ca0c67a tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.096875 Sep 23 03:30:18.457526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 687/1363] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:18 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:30:19.469033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:19.470020 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:19.476867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:19.477309 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:19.478063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:19.478492 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:19.570369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-caabc110-e9b0-442d-903e-94796e630206 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.105447 Sep 23 03:30:19.570996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 677/1364] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:19 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:20.583071 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:20.584050 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:20.590446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:20.590880 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:20.591622 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:20.592043 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:20.679312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9c91b013-ede6-43de-8265-db787f5ce36e tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.100796 Sep 23 03:30:20.680139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 688/1365] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:20 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:21.691864 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:21.692877 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:21.699405 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:21.699846 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:21.700634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:21.701061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:21.790396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-edcae4fc-c5c6-48a9-a0a5-0650989fe557 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.102430 Sep 23 03:30:21.791145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 678/1366] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:21 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:22.802760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:22.803791 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:22.810747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:22.811192 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:22.812011 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:22.812440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:22.895778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4292ec18-01f4-4836-88b0-dc92f50a14f3 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.096873 Sep 23 03:30:22.896436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 689/1367] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:22 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:23.907883 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:23.909482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:23.915902 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:23.916340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:23.917178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:23.917605 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:23.997885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4798cfa4-5b18-4f86-a8cf-b9962cb40cc4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.093971 Sep 23 03:30:23.998501 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 679/1368] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:23 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:25.010081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:25.011000 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:25.017968 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:25.018405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:25.019155 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:25.019578 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:25.108382 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-83539549-ca19-410d-9e5d-39fc7d709816 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.102269 Sep 23 03:30:25.109254 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 690/1369] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:25 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:26.120527 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:26.121462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:26.128506 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:26.128955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:26.129713 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:26.130141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:26.223156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-399bd63f-ea8a-4ad4-82df-f79a6092c693 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.106579 Sep 23 03:30:26.223820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 680/1370] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:26 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:27.235834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:27.237625 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:27.244035 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:27.244588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:27.245555 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:27.246045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:27.328159 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-efabd3eb-174c-492e-819a-ff76ba2683e2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.096814 Sep 23 03:30:27.329699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 691/1371] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:27 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:28.339735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:28.340762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:28.348123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:28.348602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:28.349359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:28.349791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:28.439328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ebae8786-62c8-4b68-8df6-eea29b8c1cb4 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.103549 Sep 23 03:30:28.439949 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 681/1372] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:28 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:29.451391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:29.452384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:29.459419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:29.459864 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:29.460663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:29.461091 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:29.540675 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-be8823e5-857e-4041-90e3-e0ef4871ba91 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 28691 microversion: 2.1 time: 0.093181 Sep 23 03:30:29.541334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 692/1373] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:29 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 28691 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:30.552746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:30.553744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:30.560295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:30.560777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:30.561537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:30.561965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:30.657674 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-1cf758b5-ccfb-426c-a207-bc06b2813da2 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 29642 microversion: 2.1 time: 0.108906 Sep 23 03:30:30.658867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 682/1374] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:30 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 29642 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:31.670488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:31.671485 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:31.677945 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:31.678384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:31.679141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:31.679573 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:31.770160 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e2a979b2-6368-420a-9438-2336f714a246 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 31890 microversion: 2.1 time: 0.103519 Sep 23 03:30:31.770805 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 693/1375] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:31 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 31890 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:32.782300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:32.783852 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:32.790383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:32.790824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:32.791584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:32.792011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:32.881350 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-824f7bb3-23eb-427c-bf9d-233cb7e5393d tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 33412 microversion: 2.1 time: 0.102961 Sep 23 03:30:32.881998 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 683/1376] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:32 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 33412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:30:33.894313 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:33.895440 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:33.901979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:33.902416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:33.903177 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:33.903605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:33.999609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-197ce8ab-fad2-4ae2-b7ac-35d2b9eb0c57 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 34508 microversion: 2.1 time: 0.109288 Sep 23 03:30:34.000223 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 694/1377] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:33 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 34508 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 03:30:35.011743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:35.012756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:35.019189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:35.019628 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:35.020370 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:35.020823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:35.117800 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9c81b486-d075-45c7-9446-089bcace0223 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 35727 microversion: 2.1 time: 0.109830 Sep 23 03:30:35.118412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 684/1378] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:35 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 35727 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:36.131716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:36.132876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:36.141565 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:36.142670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:36.143448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:36.143877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:36.246289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c995b0ae-ad83-411a-aae3-6083e9dc2109 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 37476 microversion: 2.1 time: 0.119864 Sep 23 03:30:36.246941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 695/1379] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:36 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 37476 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:37.259011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:37.260017 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:37.266515 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:37.267006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:37.267762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:37.268192 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:37.366282 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-71d27de6-09b7-4cc9-99d0-2424e53c91c9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 38226 microversion: 2.1 time: 0.111075 Sep 23 03:30:37.367126 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 685/1380] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:37 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 38226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:38.379241 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:38.380230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:38.386664 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:38.387120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:38.387861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:38.388287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:38.472782 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8b95f16c-717d-443c-aac3-05c1e9139ff8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 38226 microversion: 2.1 time: 0.097872 Sep 23 03:30:38.473653 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 696/1381] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:38 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 38226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:39.485048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:39.486060 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:39.492423 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:39.492898 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:39.493646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:39.494069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:39.574145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4a560134-e841-4e32-b03c-d5430415ce26 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 38226 microversion: 2.1 time: 0.093042 Sep 23 03:30:39.574774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 686/1382] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:39 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 38226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:40.586959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:40.587944 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:40.594679 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:40.595161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:40.595919 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:40.596372 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:40.685638 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9590f45e-ecc0-4729-9202-a24b5c3dffa5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 38226 microversion: 2.1 time: 0.102644 Sep 23 03:30:40.686308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 697/1383] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:40 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 38226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:41.697720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:41.698714 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:41.705772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:41.706215 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:41.706973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:41.707414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:41.794312 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-642381a4-c3d1-4ca6-800a-651ba8f97d33 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action" status: 200 len: 38357 microversion: 2.1 time: 0.100463 Sep 23 03:30:41.796524 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 687/1384] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:30:41 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/action => generated 38357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 03:30:41.805100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:41.805670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:41.812110 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:41.812620 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:41.813391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:41.814314 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:41.837777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ac1aa558-d687-4ef8-9e0c-382c4f7210ab tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/ips" status: 200 len: 146 microversion: 2.1 time: 0.036665 Sep 23 03:30:41.838373 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 698/1385] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Sep 23 03:30:41 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:44.458657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c19cd664-0599-4f83-b8af-54183b86b5e1"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:44.459791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:44.466476 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:44.466919 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:44.467933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:44.468379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:45.352931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-acaafa11-79a6-4d04-ad9f-46d4cecf51ce tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897833 Sep 23 03:30:45.352931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 688/1386] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:30:44 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:52.874350 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:52.875252 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:52.882311 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:52.882749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:52.883505 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:52.883928 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:52.912314 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6b018ef1-f38f-475d-9dbe-3e9803976ce9 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Sep 23 03:30:52.912903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 699/1387] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:30:52 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:52.923847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:30:52.925783 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:52.930449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:52.930893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:52.931648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:52.932080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:52.964624 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3de2f3e4-52cb-4f5c-b6fe-4a4f4c540ce7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1" status: 200 len: 194 microversion: 2.1 time: 0.045822 Sep 23 03:30:52.968368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 689/1388] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Sep 23 03:30:52 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:30:54.569968 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d2767f7-5bab-4a77-bc4f-89f505a97c6b"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:30:54.571049 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:30:54.576795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:54.577237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:54.577993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:30:54.578420 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:30:55.231614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-091d440a-4f73-4db0-88de-31e5834ee8e1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665292 Sep 23 03:30:55.232175 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 700/1389] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:30:54 2021] POST /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:31:03.791866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:03.792863 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:03.798830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:03.799271 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:03.800034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:03.800465 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:03.830066 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-291b8561-341e-4b65-b42e-9ef6eef21006 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041921 Sep 23 03:31:03.830611 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 690/1390] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:31:03 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:31:19.510572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:19.511141 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:19.517874 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:19.518315 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:19.519065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:19.519491 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:19.547587 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ff13e465-c864-4baf-b946-37c0e8b8ea51 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1" status: 200 len: 194 microversion: 2.1 time: 0.041705 Sep 23 03:31:19.548157 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 701/1391] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Sep 23 03:31:19 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:31:19.557368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:19.557850 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:19.564625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:19.565073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:19.565831 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:19.566265 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:19.647964 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lazy-loading 'services' on Instance uuid 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:31:19.883752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b960a13a-5df7-4f53-99d8-bc174c839079 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1" status: 202 len: 0 microversion: 2.1 time: 0.329878 Sep 23 03:31:19.884336 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 691/1392] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:31:19 2021] DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/c19cd664-0599-4f83-b8af-54183b86b5e1 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:31:20.102857 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:31:20.103069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:31:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:31:22.054802 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:22.055348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:22.061611 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:22.062614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:22.063378 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:22.063810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:22.096738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4e96b765-d79b-4f82-a552-14783ee9db95 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/3d2767f7-5bab-4a77-bc4f-89f505a97c6b" status: 200 len: 194 microversion: 2.1 time: 0.045576 Sep 23 03:31:22.097332 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 702/1393] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Sep 23 03:31:22 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/3d2767f7-5bab-4a77-bc4f-89f505a97c6b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:31:22.107402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:22.107974 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:22.114447 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:22.114888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:22.115643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:22.116080 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:22.196352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lazy-loading 'services' on Instance uuid 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:31:22.410140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-2dd6c115-a8b3-41d7-964b-21c9d18cc42f tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/3d2767f7-5bab-4a77-bc4f-89f505a97c6b" status: 202 len: 0 microversion: 2.1 time: 0.306565 Sep 23 03:31:22.410737 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 692/1394] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:31:22 2021] DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments/3d2767f7-5bab-4a77-bc4f-89f505a97c6b => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:31:23.578494 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:23.579399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:23.585166 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.585600 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.586354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.586776 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.615121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0440999f-fdd7-4700-878c-5cb558cbda27 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040905 Sep 23 03:31:23.615670 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 703/1395] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:31:23 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:31:23.727564 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:23.728582 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:23.734563 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.735006 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.735758 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.736195 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.763772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d7d7853e-0f92-49a2-be41-4de302206f23 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040320 Sep 23 03:31:23.764294 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 693/1396] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:31:23 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:31:23.822398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:23.822891 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:23.829274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.829714 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.830469 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:23.830901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:23.854582 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:31:24.117951 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-89ab1cd0-17e8-4324-9526-3318a906cb79 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 204 len: 0 microversion: 2.1 time: 0.298831 Sep 23 03:31:24.118540 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 704/1397] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:31:23 2021] DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:31:24.127585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:24.128166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:24.133918 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:24.134361 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:24.135112 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:24.135537 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:24.258475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:31:24.265911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-00761cb5-cc1c-4899-a553-c75e91da9cc1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1675 microversion: 2.1 time: 0.142777 Sep 23 03:31:24.266823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 694/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:24 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:31:25.283136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:25.283881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:25.289779 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:25.290206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:25.290953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:25.291375 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:25.411828 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:31:25.419288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-574bd6d9-2d42-49c8-81a3-8371d3d491d7 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1675 microversion: 2.1 time: 0.140757 Sep 23 03:31:25.419846 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 705/1399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:25 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:31:26.436169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:26.437362 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:26.443136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:26.443571 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:26.444327 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:26.444776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:26.569482 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:31:26.576761 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6df17777-11a4-4183-88da-79ae5c089f0c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1675 microversion: 2.1 time: 0.144239 Sep 23 03:31:26.577352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 695/1400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:26 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:31:27.274131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-753df338-1dfc-412f-95bf-46d5e8999b0a req-9f33cd69-d959-4981-b09d-7fe918656f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3", "name": "network-vif-deleted", "tag": "872b4157-921c-4c03-bc0d-7b7a7f08a05d"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:31:27.276367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:31:27.276367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:31:27.284605 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-753df338-1dfc-412f-95bf-46d5e8999b0a req-9f33cd69-d959-4981-b09d-7fe918656f81 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:27.285399 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-753df338-1dfc-412f-95bf-46d5e8999b0a req-9f33cd69-d959-4981-b09d-7fe918656f81 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:27.303752 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-753df338-1dfc-412f-95bf-46d5e8999b0a req-9f33cd69-d959-4981-b09d-7fe918656f81 service nova] Creating event network-vif-deleted:872b4157-921c-4c03-bc0d-7b7a7f08a05d for instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 on hv-cinder-76845 Sep 23 03:31:27.309788 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-753df338-1dfc-412f-95bf-46d5e8999b0a req-9f33cd69-d959-4981-b09d-7fe918656f81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096744 Sep 23 03:31:27.310562 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 706/1401] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:31:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:31:27.593937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:27.594544 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:27.600973 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:27.601421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:27.602179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:27.602604 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:27.635438 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:27.635880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:27.636325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lazy-loading 'fault' on Instance uuid 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:31:27.677295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2700498241084d4aa4099e8034fbeb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976c473ab2634adaa47c36dca50bf392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:31:27.684735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ce9a522a-a0bf-4b3f-8d52-a5d0e9447448 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 200 len: 1328 microversion: 2.1 time: 0.094799 Sep 23 03:31:27.685307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 696/1402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:27 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:31:28.702921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:28.703546 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:28.709682 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:28.710123 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:28.710877 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:28.711306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:28.724882 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. Sep 23 03:31:28.725452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:31:28.726261 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-37feb558-c4fd-4915-9190-d70ceb9354bf tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 404 len: 111 microversion: 2.1 time: 0.027947 Sep 23 03:31:28.726772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 707/1403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:28 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:31:28.734788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4a348e59-bdfb-4a8c-8951-0093604c667c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '.version_select at 0x7fd1b407b3a0>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:28.845830 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4a348e59-bdfb-4a8c-8951-0093604c667c tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939143316" status: 202 len: 0 microversion: 2.1 time: 0.114548 Sep 23 03:31:28.846403 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 697/1404] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Sep 23 03:31:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939143316 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:31:32.159465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:32.159982 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:32.165663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:32.166101 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:32.166845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:32.167267 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:32.180698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. Sep 23 03:31:32.181264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:31:32.182053 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-acf7e5ec-eb5a-44fa-88e3-02feb50a31e5 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 404 len: 111 microversion: 2.1 time: 0.026749 Sep 23 03:31:32.182559 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 708/1405] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:31:32 2021] DELETE /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:31:32.190119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:32.190733 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:32.196429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:32.196920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:32.197652 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:32.198082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:32.210976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. Sep 23 03:31:32.211548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance 68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:31:32.212381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c632e839-33c7-4115-80a0-6b8fbaca7432 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3" status: 404 len: 111 microversion: 2.1 time: 0.025919 Sep 23 03:31:32.212920 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 698/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:32 2021] GET /compute/v2.1/servers/68f9d4e6-1da2-4acd-afb8-9fd9bc79fde3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:31:33.475732 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:33.476209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:33.481908 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:33.482340 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:33.483089 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:33.483540 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:33.496296 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. Sep 23 03:31:33.496892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:31:33.497692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-55939efc-3b34-4f88-8690-682d3e4121e8 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 404 len: 111 microversion: 2.1 time: 0.025617 Sep 23 03:31:33.498199 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 709/1407] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:31:33 2021] DELETE /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:31:33.506409 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:31:33.507016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] [instance: db993b7a-3b47-46ed-846f-75a26878be5b] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:31:33.512817 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:33.513258 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:33.514009 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:31:33.515089 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:31:33.532347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] HTTP exception thrown: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. Sep 23 03:31:33.532960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] Returning 404 to user: Instance db993b7a-3b47-46ed-846f-75a26878be5b could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:31:33.533774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6b54b399-3f93-428b-851d-24f9cf0885f1 tempest-AttachVolumeTestJSON-1592639404 tempest-AttachVolumeTestJSON-1592639404-project] 10.222.0.23 "GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b" status: 404 len: 111 microversion: 2.1 time: 0.031077 Sep 23 03:31:33.534295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 699/1408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:31:33 2021] GET /compute/v2.1/servers/db993b7a-3b47-46ed-846f-75a26878be5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:32:33.675664 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'create', calling method: .version_select at 0x7fd1af7db430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1003061922"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:32:33.693395 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:32:33.697115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for user 9f095853fa9e478699437602d269e7df and project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:32:34.158745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:32:34.162404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for user 9f095853fa9e478699437602d269e7df and project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'key_pairs'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:32:34.174855 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-29cf2d9e-95d9-425d-9eb7-4d1763a63256 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.503722 Sep 23 03:32:34.175436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 710/1409] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Sep 23 03:32:33 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:34.223461 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-812716333", "imageRef": "eb6ff1fe-ed71-41a0-8a54-787613c3e407", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1003061922", "networks": [{"uuid": "a9584aa7-1125-41a0-a42a-9b3bb6be5e78"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:32:34.274088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] validate_networks() for [('a9584aa7-1125-41a0-a42a-9b3bb6be5e78', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:32:34.941135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:32:34.941573 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:32:34.942033 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:32:34.942660 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:32:34.943059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:32:34.951559 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:34.951996 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:34.952822 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:34.953244 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:34.971226 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:32:34.975010 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Getting quotas for user 9f095853fa9e478699437602d269e7df and project d44cc135efd34c2ebd0b06caba26bca7. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:32:34.985809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:32:34.988025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb6ff1fe-ed71-41a0-8a54-787613c3e407',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:32:35.108301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-dd98987d-0c25-4ce3-8e59-a7bcb7d5c2d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889222 Sep 23 03:32:35.108905 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 700/1410] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:32:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:32:35.118418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6200975a-a1d2-4d5f-9108-a7c904d4416c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:35.119031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6200975a-a1d2-4d5f-9108-a7c904d4416c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:35.172011 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6200975a-a1d2-4d5f-9108-a7c904d4416c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:35.178528 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6200975a-a1d2-4d5f-9108-a7c904d4416c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1258 microversion: 2.1 time: 0.063758 Sep 23 03:32:35.179092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 711/1411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:35 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:32:36.195381 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e21044a0-5074-4172-8b29-c391ef66ffe8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:36.196110 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e21044a0-5074-4172-8b29-c391ef66ffe8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:36.249018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-e21044a0-5074-4172-8b29-c391ef66ffe8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:36.255854 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e21044a0-5074-4172-8b29-c391ef66ffe8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1258 microversion: 2.1 time: 0.064564 Sep 23 03:32:36.256681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 701/1412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:36 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:37.277092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:37.278201 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:37.284977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:37.285421 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:37.286173 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:37.286601 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:37.345893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:37.353197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-33a7c98b-f701-497e-80f1-d3a44d4314b5 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1310 microversion: 2.1 time: 0.079831 Sep 23 03:32:37.353747 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 712/1413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:37 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:38.370375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:38.370976 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:38.378254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:38.378687 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:38.379451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:38.379872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:38.521566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:38.529640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-7c6289f8-9992-4537-810f-235d83513210 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.162802 Sep 23 03:32:38.530214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 702/1414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:38 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:39.445282 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-114f1e37-8396-4720-8201-fa77afbcc3b7 req-1ffb6776-4ee9-42c5-85b7-9338ecbbb9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:32:39.447186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:32:39.447186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:32:39.458211 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-114f1e37-8396-4720-8201-fa77afbcc3b7 req-1ffb6776-4ee9-42c5-85b7-9338ecbbb9bf service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:39.458957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-114f1e37-8396-4720-8201-fa77afbcc3b7 req-1ffb6776-4ee9-42c5-85b7-9338ecbbb9bf service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:39.478897 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-114f1e37-8396-4720-8201-fa77afbcc3b7 req-1ffb6776-4ee9-42c5-85b7-9338ecbbb9bf service nova] Creating event network-changed:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:32:39.485832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-114f1e37-8396-4720-8201-fa77afbcc3b7 req-1ffb6776-4ee9-42c5-85b7-9338ecbbb9bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044220 Sep 23 03:32:39.486777 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 713/1415] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:32:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:32:39.546472 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:39.547187 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:39.554159 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:39.554599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:39.555739 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:39.556236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:39.692990 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:39.701148 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3a8a881e-be0d-4b01-ade6-24ba9af18f80 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.158464 Sep 23 03:32:39.701844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 703/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:39 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:40.719365 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:40.720354 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:40.726698 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:40.727385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:40.728435 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:40.729075 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:40.859385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:40.867299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5da793e9-b895-4ae6-8a06-457df3d59cbe tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.152829 Sep 23 03:32:40.870164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 714/1417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:40 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:41.883876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:41.884478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:41.890435 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:41.893250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:41.893250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:41.893250 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:42.014164 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:42.021680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9043840f-e65b-41d4-8bb5-8b761d61d197 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.141409 Sep 23 03:32:42.031677 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 704/1418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:41 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:32:43.038680 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:43.039290 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:43.045704 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:43.046138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:43.046893 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:43.047320 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:43.171878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:43.179630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-245904ce-6b07-4745-b56d-e576fe75ccd7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.144510 Sep 23 03:32:43.180308 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 715/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:43 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:44.196297 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:44.197036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:44.203135 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:44.203657 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:44.204419 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:44.204887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:44.337119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:44.345866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3ac53208-cd74-482d-8286-e465bd6c6f78 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.153244 Sep 23 03:32:44.346436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 705/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:44 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:45.362728 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:45.363498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:45.374865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:45.375318 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:45.376268 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:45.376570 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:45.502580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:45.510383 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3f1d5eb5-a17c-45d2-8f2b-9c48035795fc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.151263 Sep 23 03:32:45.511225 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 716/1421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:45 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:46.526956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:46.527615 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:46.533414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:46.533856 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:46.534612 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:46.535091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:46.657278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:46.664642 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-14b262fd-05b8-4a9f-9366-09ddd444465c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.141323 Sep 23 03:32:46.665197 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 706/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:46 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:47.683984 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:47.685489 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:47.692285 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:47.692749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:47.693518 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:47.693941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:47.828169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:47.836790 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8d4c9713-9262-4972-97f8-442b17e73be8 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.158216 Sep 23 03:32:47.842468 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 717/1423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:47 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:48.853640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:48.854251 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:48.860681 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:48.870359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:48.870359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:48.870359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:48.980711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:48.987788 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-69a67ad3-9070-448e-a1c7-f0d42ffe52b2 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.137830 Sep 23 03:32:48.988347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 707/1424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:48 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:50.004774 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:50.005367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:50.011239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:50.012189 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:50.012973 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:50.013401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:50.128140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:50.135293 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e4da8db1-f9d2-4473-a4c8-7ad8487783a3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.134243 Sep 23 03:32:50.135861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 718/1425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:49 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:51.153196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:51.153801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:51.159490 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:51.159933 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:51.160712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:51.161145 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:51.288577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:51.296777 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fd4279eb-04c8-441d-93ff-62d9cd98ae07 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.147631 Sep 23 03:32:51.297366 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 708/1426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:51 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:52.313216 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:52.313825 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:52.319716 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:52.320158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:52.320937 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:52.321368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:52.440341 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:52.447610 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-eb782ba6-eee9-4c7e-966d-2c11f381a7d6 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.138088 Sep 23 03:32:52.448181 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 719/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:52 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:53.463915 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:53.465125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:53.475767 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:53.476212 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:53.477028 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:53.477456 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:53.608269 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:53.616005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-86f80ae9-db5a-4977-ba27-6cb07804cda3 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.155696 Sep 23 03:32:53.616603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 709/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:53 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:54.631817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:54.632422 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:54.639017 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:54.639457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:54.640209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:54.640666 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:54.771147 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:54.778511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9b051441-5ee4-41a8-9389-251e503f345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.150312 Sep 23 03:32:54.779078 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 720/1429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:54 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:55.794752 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:55.795361 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:55.801259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:55.801698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:55.802453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:55.802882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:55.919519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:55.926639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-10241d0f-a179-4293-b61d-40175ef5095e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.135558 Sep 23 03:32:55.927196 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 710/1430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:55 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:56.943097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:56.943820 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:56.949650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:56.950087 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:56.950838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:56.951262 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:56.977746 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1384996b-d4b2-4c5c-ac7e-2438ebb192c3 req-b009e0f9-6317-4cfd-a9de-72ca673e2602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "name": "network-vif-plugged", "status": "completed", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:32:56.979336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:32:56.979336 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:32:56.987231 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1384996b-d4b2-4c5c-ac7e-2438ebb192c3 req-b009e0f9-6317-4cfd-a9de-72ca673e2602 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:56.987759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1384996b-d4b2-4c5c-ac7e-2438ebb192c3 req-b009e0f9-6317-4cfd-a9de-72ca673e2602 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:56.999312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1384996b-d4b2-4c5c-ac7e-2438ebb192c3 req-b009e0f9-6317-4cfd-a9de-72ca673e2602 service nova] Creating event network-vif-plugged:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:32:57.004913 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1384996b-d4b2-4c5c-ac7e-2438ebb192c3 req-b009e0f9-6317-4cfd-a9de-72ca673e2602 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145753 Sep 23 03:32:57.005674 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 721/1431] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:32:57.136992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:57.144379 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-38a9a55d-f066-4052-a464-4a6db5691071 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.204979 Sep 23 03:32:57.145704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 711/1432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:56 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:32:58.161959 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:58.162577 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:58.168759 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:58.169209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:58.169977 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:58.170413 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:58.345191 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:58.352319 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-6af13223-1396-413f-981c-159b9116345d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1358 microversion: 2.1 time: 0.194432 Sep 23 03:32:58.352924 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 722/1433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:58 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:59.368778 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:59.369360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:59.375799 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.376243 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.377036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.377468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.499152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:59.506365 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5b792103-5d85-415e-a4d3-737e4490e65f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1548 microversion: 2.1 time: 0.141343 Sep 23 03:32:59.506931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 712/1434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:59 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1548 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:59.521857 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:59.522465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:59.530197 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.530700 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.531634 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.532138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.656795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:59.664940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d7e02dd1-0246-48bc-a12f-79d11fd48c6d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1548 microversion: 2.1 time: 0.146658 Sep 23 03:32:59.665616 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 723/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:59 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:32:59.680625 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:59.684530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:32:59.684530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:32:59.685523 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:32:59.686182 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Searching by: {'deleted': False, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7'} {{(pid=108954) get_all /opt/stack/nova/nova/compute/api.py:2905}} Sep 23 03:32:59.692500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.692956 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.693743 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.694166 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.780885 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.multi_cell_list [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108954) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 23 03:32:59.874795 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-17fca533-5f02-4149-a0a8-9f61e960751f tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197610 Sep 23 03:32:59.875364 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 713/1436] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Sep 23 03:32:59 2021] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:32:59.885569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:32:59.886355 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:32:59.892470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.892938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:32:59.893686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:32:59.894112 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:00.010736 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:33:00.017938 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-bb3e23f2-63a4-4b96-9352-3b635b53c47a tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1548 microversion: 2.1 time: 0.136326 Sep 23 03:33:00.018500 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 724/1437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:32:59 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:33:02.925113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76a9fba4-0131-4f41-9b5e-3dacde82e6ed"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:33:02.926209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:33:02.932065 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:02.935331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:02.935331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:02.935331 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:03.813551 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c6f4227c-3234-463b-ac4d-7eb787527f62 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892009 Sep 23 03:33:03.814160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 714/1438] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Sep 23 03:33:02 2021] POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:33:12.429976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:33:12.430586 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:33:12.436334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:12.436811 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:12.437566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:12.438020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:12.556569 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:33:12.564775 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3ceb7a30-b8c6-4064-afd1-1285a5859bc1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1594 microversion: 2.1 time: 0.138532 Sep 23 03:33:12.565367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 725/1439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:33:12 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1594 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:33:14.531400 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-25cfab3f-d8b3-4fe2-b3a2-90c9c1da4e34 req-27d6e6e4-bf2a-40db-b58a-9e9562bb273e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:33:14.533214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:33:14.533214 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:33:14.541306 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-25cfab3f-d8b3-4fe2-b3a2-90c9c1da4e34 req-27d6e6e4-bf2a-40db-b58a-9e9562bb273e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:14.541911 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-25cfab3f-d8b3-4fe2-b3a2-90c9c1da4e34 req-27d6e6e4-bf2a-40db-b58a-9e9562bb273e service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:14.552796 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-25cfab3f-d8b3-4fe2-b3a2-90c9c1da4e34 req-27d6e6e4-bf2a-40db-b58a-9e9562bb273e service nova] Creating event network-changed:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:33:14.558014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-25cfab3f-d8b3-4fe2-b3a2-90c9c1da4e34 req-27d6e6e4-bf2a-40db-b58a-9e9562bb273e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031953 Sep 23 03:33:14.560762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 715/1440] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:33:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:33:16.917364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-918943856"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:33:16.917987 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:33:16.923749 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:16.926328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:16.926328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:16.926328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:17.039499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.network.security_group_api [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Adding security group feeb4b82-432a-4297-93f0-4bd88ff32314 to port ccd50c60-beeb-405d-b3f0-d27b93d7762c Sep 23 03:33:17.433867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2874e8d1-0e5a-40a6-bc7a-ab7a5551b5ef tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action" status: 202 len: 0 microversion: 2.1 time: 0.520733 Sep 23 03:33:17.435389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 726/1441] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:33:16 2021] POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:33:17.445179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:33:17.447323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:33:17.465037 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:17.465936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:17.467567 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-fb24b341-d25b-4a84-a199-ca63e11b7be5 req-7380966d-9966-4b65-972d-7677e433cad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:33:17.468872 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:17.470363 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:17.474507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:33:17.474507 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:33:17.484598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fb24b341-d25b-4a84-a199-ca63e11b7be5 req-7380966d-9966-4b65-972d-7677e433cad0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:33:17.485044 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-fb24b341-d25b-4a84-a199-ca63e11b7be5 req-7380966d-9966-4b65-972d-7677e433cad0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:33:17.501531 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-fb24b341-d25b-4a84-a199-ca63e11b7be5 req-7380966d-9966-4b65-972d-7677e433cad0 service nova] Creating event network-changed:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:33:17.508514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-fb24b341-d25b-4a84-a199-ca63e11b7be5 req-7380966d-9966-4b65-972d-7677e433cad0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053553 Sep 23 03:33:17.509778 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 727/1442] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:33:17.633608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:33:17.643728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-60ebf9c9-bd18-49c5-9f6c-abef140d2504 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1759 microversion: 2.1 time: 0.203306 Sep 23 03:33:17.645328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 716/1443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:33:17 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:34:05.844969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:34:05.846001 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:05.852675 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:05.853121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:05.853878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:05.854306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:06.095041 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-eaf88f90-a898-4696-81c0-0d2c9034ba89 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action" status: 202 len: 0 microversion: 2.1 time: 0.254470 Sep 23 03:34:06.095922 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 728/1444] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:34:05 2021] POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:34:06.104479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:06.105147 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:06.111307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:06.113225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:06.113225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:06.113225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:06.236396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:06.244432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-26952265-c454-434e-a9fe-ec18feea457e tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1751 microversion: 2.1 time: 0.144589 Sep 23 03:34:06.247059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 717/1445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:06 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1751 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:07.261766 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:07.262448 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:07.268398 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:07.268867 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:07.269615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:07.270037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:07.397140 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:07.405387 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c609ed5b-01de-43d8-8e30-da48c3335636 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.147652 Sep 23 03:34:07.405950 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 729/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:07 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:08.422951 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:08.424041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:08.429924 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:08.430369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:08.431125 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:08.431557 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:08.551811 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:08.559844 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-09bb7326-b14e-42be-9921-fbb2c5afb408 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.140584 Sep 23 03:34:08.560412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 718/1447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:08 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:09.577168 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:09.577761 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:09.583595 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:09.584033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:09.584815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:09.585242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:09.712377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:09.720288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b9d01c23-7d78-46c2-85ec-25a35c9b909b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.146914 Sep 23 03:34:09.720885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 730/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:09 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:10.737036 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:10.737629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:10.743893 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:10.744328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:10.745109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:10.745562 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:10.871092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:10.881075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-393d34e4-9a7d-4c43-bdf2-c013efb18e21 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.147655 Sep 23 03:34:10.881648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 719/1449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:10 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:11.899368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:11.899970 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:11.905758 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:11.906196 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:11.906957 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:11.907384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:12.025878 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:12.033953 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-96c522bb-ce68-4f81-9aff-0c69a7d58890 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.138836 Sep 23 03:34:12.034883 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 731/1450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:11 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:13.097566 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:13.098169 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:13.103867 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:13.104307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:13.105116 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:13.105542 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:13.223806 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:13.231620 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-54fab6d4-a9fa-4003-baee-388b5fdb9388 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.137625 Sep 23 03:34:13.232221 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 720/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:13 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:14.248604 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:14.249139 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:14.255232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:14.255660 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:14.256406 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:14.256851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:14.379702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:14.387814 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c3339544-c2d9-44ab-b2cc-f0d128008fdf tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.143086 Sep 23 03:34:14.388376 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 732/1452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:14 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:15.404732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:15.405266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:15.411050 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:15.411493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:15.412246 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:15.412702 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:15.531460 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:15.539085 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6e91fc97-c18e-4c11-bed6-fbfa4b42ff19 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.138133 Sep 23 03:34:15.540160 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 721/1453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:15 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:16.557323 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:16.557923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:16.563702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:16.564136 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:16.564912 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:16.565337 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:16.687809 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:16.695428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-a916ef89-1ecf-497d-b614-40e8801e7550 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.142811 Sep 23 03:34:16.695992 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 733/1454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:16 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:17.712098 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:17.712963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:17.718785 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:17.719231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:17.719979 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:17.720410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:17.848178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:17.856550 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-21fdab2d-ace9-4634-ac2e-f7a4cd2ee3bd tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.148682 Sep 23 03:34:17.857113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 722/1455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:17 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:18.873757 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:18.874359 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:18.880288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:18.880797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:18.881553 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:18.881976 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:19.001158 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:19.008807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4a255c7d-b730-4b0b-8cd2-d7b72df7215c tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.138724 Sep 23 03:34:19.009368 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 734/1456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:18 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:20.025549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:20.026155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:20.032369 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:20.032847 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:20.033600 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:20.034032 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:20.304952 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:20.313146 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-dbaa0b23-f664-45f4-9078-9b3efe9adf28 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.291232 Sep 23 03:34:20.313711 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 723/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:20 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:21.330839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:21.331358 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:21.337960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:21.338390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:21.339135 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:21.339556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:21.460514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:21.469114 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-5cc0dcc7-7f9e-4ed8-81e1-d86c6d4ddb13 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.142000 Sep 23 03:34:21.469676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 735/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:21 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:22.485991 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:22.486593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:22.492895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:22.493333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:22.494075 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:22.494501 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:22.618655 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:22.626278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-48e6f194-be52-4b93-873c-73860572d801 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1756 microversion: 2.1 time: 0.143962 Sep 23 03:34:22.626832 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 724/1459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:22 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:23.642943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:34:23.643572 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:34:23.649835 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:23.650270 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:23.651014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:34:23.651436 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:34:23.770230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:34:23.778118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d0ff1bd6-37fa-46d2-ac58-169278ae7bf9 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1759 microversion: 2.1 time: 0.138871 Sep 23 03:34:23.778678 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 736/1460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:34:23 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1759 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:34:37.971488 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:34:37.972185 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:34:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:34:44.419699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:34:44.420391 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:34:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:35:19.228082 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-918943856"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:35:19.228646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:19.234503 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:19.234946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:19.235699 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:19.236129 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:19.353393 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.network.security_group_api [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Removing security group feeb4b82-432a-4297-93f0-4bd88ff32314 from port ccd50c60-beeb-405d-b3f0-d27b93d7762c Sep 23 03:35:19.743682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5ba3b169-a15b-4f4a-a832-3e103e2a2d84 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action" status: 202 len: 0 microversion: 2.1 time: 0.515615 Sep 23 03:35:19.743682 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 725/1461] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Sep 23 03:35:19 2021] POST /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:35:19.841870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-c8ec15d1-8698-4b90-b9da-ef4a8b582651 req-b2ec7501-1d50-4d19-b22e-06bed8ca1856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:35:19.844693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:35:19.844693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:35:19.852449 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-c8ec15d1-8698-4b90-b9da-ef4a8b582651 req-b2ec7501-1d50-4d19-b22e-06bed8ca1856 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:19.853015 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-c8ec15d1-8698-4b90-b9da-ef4a8b582651 req-b2ec7501-1d50-4d19-b22e-06bed8ca1856 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:19.869687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-c8ec15d1-8698-4b90-b9da-ef4a8b582651 req-b2ec7501-1d50-4d19-b22e-06bed8ca1856 service nova] Creating event network-changed:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:35:19.875349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-c8ec15d1-8698-4b90-b9da-ef4a8b582651 req-b2ec7501-1d50-4d19-b22e-06bed8ca1856 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126207 Sep 23 03:35:19.876257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 737/1462] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:35:20.964655 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:20.965150 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:20.971047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:20.971495 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:20.972254 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:20.972719 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:21.061360 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lazy-loading 'services' on Instance uuid 18737efa-03ed-468b-a089-17c29c86cf34 {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:35:21.295074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c1db2c86-11e3-4d36-bfd0-90ce16b2e65d tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments/76a9fba4-0131-4f41-9b5e-3dacde82e6ed" status: 202 len: 0 microversion: 2.1 time: 0.334913 Sep 23 03:35:21.295663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 726/1463] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:35:20 2021] DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments/76a9fba4-0131-4f41-9b5e-3dacde82e6ed => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:35:21.305659 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:21.309130 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:21.314209 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:21.314731 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:21.315722 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:21.316220 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:21.346446 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-448ef907-3619-4e39-b60d-3f7ef7d0cba1 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Sep 23 03:35:21.347027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 738/1464] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:35:21 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:35:21.891774 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-b3dc6e3c-2545-41d2-9f56-deed7da3a6c3 req-df983780-a1fb-49f1-b42f-87a05645052a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:35:21.893349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:35:21.893349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:35:21.901383 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b3dc6e3c-2545-41d2-9f56-deed7da3a6c3 req-df983780-a1fb-49f1-b42f-87a05645052a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:21.901746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-b3dc6e3c-2545-41d2-9f56-deed7da3a6c3 req-df983780-a1fb-49f1-b42f-87a05645052a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:21.912670 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-b3dc6e3c-2545-41d2-9f56-deed7da3a6c3 req-df983780-a1fb-49f1-b42f-87a05645052a service nova] Creating event network-changed:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:35:21.917910 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-b3dc6e3c-2545-41d2-9f56-deed7da3a6c3 req-df983780-a1fb-49f1-b42f-87a05645052a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030043 Sep 23 03:35:21.918519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 727/1465] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:35:22.357321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:22.358974 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:22.365162 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:22.365598 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:22.366537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:22.367702 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:22.397309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-dedf00ea-ef7e-4daf-8b7a-d6344f6e4ecc tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Sep 23 03:35:22.397863 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 739/1466] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:35:22 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:35:23.409471 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:23.410431 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:23.416436 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:23.416903 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:23.417764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:23.418181 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:23.444907 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-e527d248-1792-4fa9-b73c-50be3103a607 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039710 Sep 23 03:35:23.445941 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 728/1467] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Sep 23 03:35:23 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 03:35:23.455621 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:23.456214 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:23.462837 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:23.463275 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:23.464033 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:23.464459 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:23.540263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] HTTP exception thrown: Instance 18737efa-03ed-468b-a089-17c29c86cf34 is not attached to volume 76a9fba4-0131-4f41-9b5e-3dacde82e6ed Sep 23 03:35:23.540900 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Returning 404 to user: Instance 18737efa-03ed-468b-a089-17c29c86cf34 is not attached to volume 76a9fba4-0131-4f41-9b5e-3dacde82e6ed {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:35:23.541730 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-25413a99-65e3-4ee3-9476-c23d7f6c4016 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments/76a9fba4-0131-4f41-9b5e-3dacde82e6ed" status: 404 len: 154 microversion: 2.1 time: 0.089990 Sep 23 03:35:23.542277 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 740/1468] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Sep 23 03:35:23 2021] DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34/os-volume_attachments/76a9fba4-0131-4f41-9b5e-3dacde82e6ed => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 03:35:24.830538 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:24.831043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:24.837881 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:24.838329 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:24.839097 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:24.839530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:24.863053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:35:25.226410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9c00f033-2406-48d6-b9cc-c81f51513614 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 204 len: 0 microversion: 2.1 time: 0.399226 Sep 23 03:35:25.226992 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 729/1469] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:35:24 2021] DELETE /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:35:25.234839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:25.235556 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:25.241441 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:25.243560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:25.243560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:25.243560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:25.515927 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:35:25.523396 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1bc532de-cbca-4122-a598-5ed0314aa33b tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1554 microversion: 2.1 time: 0.292240 Sep 23 03:35:25.523943 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 741/1470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:35:25 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:35:26.540908 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:26.541596 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:26.547470 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:26.547914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:26.548712 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:26.549141 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:26.669643 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:35:26.676772 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-cb49365d-bb84-45ae-805d-52b0f4818656 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1554 microversion: 2.1 time: 0.140475 Sep 23 03:35:26.677338 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 730/1471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:35:26 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1554 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:35:27.696183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:27.696862 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:27.702907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:27.703402 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:27.704170 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:27.704628 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:27.776608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-4dd14e63-f3dc-4ca1-838b-e79d5ad85114 req-16e722eb-8b57-4c3f-b962-042ed01481d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18737efa-03ed-468b-a089-17c29c86cf34", "name": "network-vif-deleted", "tag": "ccd50c60-beeb-405d-b3f0-d27b93d7762c"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:35:27.778156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:35:27.778156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:35:27.784975 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-4dd14e63-f3dc-4ca1-838b-e79d5ad85114 req-16e722eb-8b57-4c3f-b962-042ed01481d7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:27.785414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-4dd14e63-f3dc-4ca1-838b-e79d5ad85114 req-16e722eb-8b57-4c3f-b962-042ed01481d7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:27.793020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f095853fa9e478699437602d269e7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44cc135efd34c2ebd0b06caba26bca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:35:27.796025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-4dd14e63-f3dc-4ca1-838b-e79d5ad85114 req-16e722eb-8b57-4c3f-b962-042ed01481d7 service nova] Creating event network-vif-deleted:ccd50c60-beeb-405d-b3f0-d27b93d7762c for instance 18737efa-03ed-468b-a089-17c29c86cf34 on hv-cinder-76845 Sep 23 03:35:27.800838 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-4dd14e63-f3dc-4ca1-838b-e79d5ad85114 req-16e722eb-8b57-4c3f-b962-042ed01481d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028465 Sep 23 03:35:27.801348 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-9d5f58cd-f368-4ae4-9945-d3adf7c6c113 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 200 len: 1512 microversion: 2.1 time: 0.108825 Sep 23 03:35:27.801475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 731/1472] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:35:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:35:27.810401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 742/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:35:27 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:35:28.818597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:28.819288 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] [instance: 18737efa-03ed-468b-a089-17c29c86cf34] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:35:28.826152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:28.826152 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:28.826613 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:35:28.827045 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:35:28.840107 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] HTTP exception thrown: Instance 18737efa-03ed-468b-a089-17c29c86cf34 could not be found. Sep 23 03:35:28.840718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Returning 404 to user: Instance 18737efa-03ed-468b-a089-17c29c86cf34 could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:35:28.841578 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5f5ef77f-a67e-4779-a48e-ace639c032e7 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34" status: 404 len: 111 microversion: 2.1 time: 0.027191 Sep 23 03:35:28.842091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 732/1474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:35:28 2021] GET /compute/v2.1/servers/18737efa-03ed-468b-a089-17c29c86cf34 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:35:28.850064 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1237f6ec-3dc2-4d40-a315-0651cf6e7a04 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] Calling method '.version_select at 0x7fd1b40b30d0>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:35:28.953311 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1237f6ec-3dc2-4d40-a315-0651cf6e7a04 tempest-TestMinimumBasicScenario-1801896458 tempest-TestMinimumBasicScenario-1801896458-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1003061922" status: 202 len: 0 microversion: 2.1 time: 0.106852 Sep 23 03:35:28.953907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 743/1475] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Sep 23 03:35:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1003061922 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:35:52.045012 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Action: 'create', calling method: .version_select at 0x7fd1b40cbdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1478765032"}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:35:52.062876 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for project ef0ca626043a48c88655009268a6ce40. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:35:52.066756 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for user eb1d7b6df9554a2da3ccd85d982cd8a7 and project ef0ca626043a48c88655009268a6ce40. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:35:52.481704 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for project ef0ca626043a48c88655009268a6ce40. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:35:52.485538 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for user eb1d7b6df9554a2da3ccd85d982cd8a7 and project ef0ca626043a48c88655009268a6ce40. Resources: {'key_pairs'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:35:52.498789 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-417bf81d-9f46-42a6-9eb1-fbf13a2b82cf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.629459 Sep 23 03:35:52.499462 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 733/1476] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Sep 23 03:35:51 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:36:19.065040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:36:19.068346 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-287611239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1478765032", "security_groups": [{"name": "tempest-secgroup-smoke-1454802404"}], "block_device_mapping_v2": [{"uuid": "b9520b96-2ca5-49a0-9e62-5f196bc8fe00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96d4f41a-803c-46c5-8381-2a138296e8f6"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:36:19.167854 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] validate_networks() for [('96d4f41a-803c-46c5-8381-2a138296e8f6', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:36:19.617457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:36:19.617870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:36:19.618330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:36:19.618726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:36:19.619133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:36:19.627537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:19.627975 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:19.628806 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:19.629230 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:19.645240 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:36:19.649062 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for user eb1d7b6df9554a2da3ccd85d982cd8a7 and project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:36:19.708389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:36:19.710817 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9520b96-2ca5-49a0-9e62-5f196bc8fe00',volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:36:20.082630 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37080. Sep 23 03:36:20.164739 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-01444dc1-9e33-453c-8c09-3f8130b5d0f8 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.100965 Sep 23 03:36:20.165374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 744/1477] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:36:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:36:20.176286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-dcc655c5-1b37-4230-a570-9a52f7743498 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:20.176960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-dcc655c5-1b37-4230-a570-9a52f7743498 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:20.236348 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-dcc655c5-1b37-4230-a570-9a52f7743498 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:20.242499 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-dcc655c5-1b37-4230-a570-9a52f7743498 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1094 microversion: 2.1 time: 0.070733 Sep 23 03:36:20.243069 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 734/1478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:20 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:21.259400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:21.259947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:21.266486 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:21.266930 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:21.267693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:21.268126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:21.325738 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:21.333250 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-2918e5a0-7603-4c2d-8a27-7f3e2bee8b6c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1144 microversion: 2.1 time: 0.077200 Sep 23 03:36:21.333474 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 745/1479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:21 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:22.349839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:22.350441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:22.356824 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:22.357273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:22.358044 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:22.358478 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:22.419162 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:22.426629 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-43e5b9cd-3e32-43b7-8e65-a8586346341a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1192 microversion: 2.1 time: 0.080508 Sep 23 03:36:22.427439 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 735/1480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:22 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:36:23.447866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:23.449013 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:23.454917 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:23.455288 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:23.456037 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:23.456457 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:23.694133 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:23.701585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-572011fc-11a8-4641-9633-3a9d8c125544 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1278 microversion: 2.1 time: 0.257308 Sep 23 03:36:23.702566 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 746/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:23 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:24.331063 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-8d6f514d-c1d0-473e-aa0d-c73b21c7cd5a req-997c0b62-a789-4fe6-b4b7-7dbeb7ae5bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8504d6a0-bcd7-4ae0-8179-ccfc733924fc", "tag": "78815846-3902-4af8-9cfb-b4b45cd307b9"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:36:24.332690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:36:24.332690 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:36:24.341323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-8d6f514d-c1d0-473e-aa0d-c73b21c7cd5a req-997c0b62-a789-4fe6-b4b7-7dbeb7ae5bd5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:24.341900 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-8d6f514d-c1d0-473e-aa0d-c73b21c7cd5a req-997c0b62-a789-4fe6-b4b7-7dbeb7ae5bd5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:24.359203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-8d6f514d-c1d0-473e-aa0d-c73b21c7cd5a req-997c0b62-a789-4fe6-b4b7-7dbeb7ae5bd5 service nova] Creating event network-changed:78815846-3902-4af8-9cfb-b4b45cd307b9 for instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc on hv-cinder-76845 Sep 23 03:36:24.363762 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-8d6f514d-c1d0-473e-aa0d-c73b21c7cd5a req-997c0b62-a789-4fe6-b4b7-7dbeb7ae5bd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036376 Sep 23 03:36:24.364480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 736/1482] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:36:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:36:24.721703 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:24.722299 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:24.728129 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:24.728632 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:24.729972 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:24.730405 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:24.941479 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:24.949271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-cfbe6920-37ad-4f4f-9ea1-16ab515283f6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.231179 Sep 23 03:36:24.949826 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 747/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:24 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:25.966378 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:25.967061 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:25.972948 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:25.973375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:25.974121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:25.974547 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:26.102540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:26.111301 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-68ffed8a-cfde-4ca0-9005-e6d85373913b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.148965 Sep 23 03:36:26.111939 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 737/1484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:25 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:27.129890 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:27.130445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:27.136919 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:27.137378 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:27.138121 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:27.138547 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:27.262393 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:27.269870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-793bc39c-660c-4ce5-b5c6-d5029e7c90bf tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.143755 Sep 23 03:36:27.270526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 748/1485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:27 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:28.286648 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:28.293153 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:28.293285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:28.293669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:28.294430 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:28.294860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:28.413451 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:28.421055 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-abcfaadc-d6d9-4b61-a97f-69b9a7917424 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.138207 Sep 23 03:36:28.421623 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 738/1486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:28 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:29.437969 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:29.438523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:29.444210 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:29.444690 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:29.445445 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:29.445865 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:29.569077 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:29.576222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f4815822-5d5e-4738-a097-019e77dd411a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.142021 Sep 23 03:36:29.576822 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 749/1487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:29 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:30.593359 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:30.593959 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:30.599694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:30.600132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:30.600917 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:30.601342 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:30.720710 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:30.727880 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c8bde8ee-2745-4287-81a0-bd589cbeb549 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.138270 Sep 23 03:36:30.728441 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 739/1488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:30 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:31.744364 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:31.745027 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:31.750808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:31.751245 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:31.751994 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:31.752417 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:31.870115 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:31.877304 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-347eed87-9eee-45d9-b4a1-b9f79df5fecc tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.136621 Sep 23 03:36:31.878385 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 750/1489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:31 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:32.894553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:32.895183 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:32.901577 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:32.902018 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:32.902765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:32.903189 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:33.019023 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:33.026650 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4d14cb8e-0d7a-41ab-bd48-4133d3d76853 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.135783 Sep 23 03:36:33.027204 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 740/1490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:32 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:34.043511 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:34.044131 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:34.050120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:34.050563 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:34.051353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:34.051786 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:34.170836 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:34.178687 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-599801f1-2d7f-4d1c-a679-3fb927cf5116 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.139345 Sep 23 03:36:34.179253 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 751/1491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:34 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:35.195801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:35.196429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:35.202494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:35.202940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:35.203703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:35.204140 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:35.320380 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:35.327634 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0dc356ad-3a56-454d-a53d-c097f3a2124e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.135528 Sep 23 03:36:35.328266 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 741/1492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:35 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:36.155797 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-a39a89d0-765b-4bc7-bf01-5f1c5596ba2e req-ff2493fe-282a-4f20-865d-82fc1b7978a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8504d6a0-bcd7-4ae0-8179-ccfc733924fc", "name": "network-vif-plugged", "status": "completed", "tag": "78815846-3902-4af8-9cfb-b4b45cd307b9"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:36:36.157404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:36:36.157404 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:36:36.164108 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a39a89d0-765b-4bc7-bf01-5f1c5596ba2e req-ff2493fe-282a-4f20-865d-82fc1b7978a5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:36.164583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-a39a89d0-765b-4bc7-bf01-5f1c5596ba2e req-ff2493fe-282a-4f20-865d-82fc1b7978a5 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:36.176545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-a39a89d0-765b-4bc7-bf01-5f1c5596ba2e req-ff2493fe-282a-4f20-865d-82fc1b7978a5 service nova] Creating event network-vif-plugged:78815846-3902-4af8-9cfb-b4b45cd307b9 for instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc on hv-cinder-76845 Sep 23 03:36:36.181544 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-a39a89d0-765b-4bc7-bf01-5f1c5596ba2e req-ff2493fe-282a-4f20-865d-82fc1b7978a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029455 Sep 23 03:36:36.182626 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 752/1493] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:36:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:36:36.344839 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:36.345429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:36.351446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:36.359349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:36.359349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:36.359349 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:36.480047 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:36.487291 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4d7d51d7-7d72-414b-8688-3a5417ad23b1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.146226 Sep 23 03:36:36.487845 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 742/1494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:36 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:37.504734 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:37.505353 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:37.511303 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:37.511748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:37.512529 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:37.512965 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:37.629866 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:37.637102 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b1b58768-2616-4985-bd31-b195808b5a09 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1266 microversion: 2.1 time: 0.136516 Sep 23 03:36:37.637658 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 753/1495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:37 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:38.654209 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:38.654988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:38.662589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:38.664865 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:38.665663 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:38.666109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:38.793940 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:38.801602 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bc5b2998-280e-4441-a697-2d7ce72f52f9 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1454 microversion: 2.1 time: 0.151782 Sep 23 03:36:38.802168 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 743/1496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:38 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:38.820200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:36:38.820916 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:36:38.827416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:38.828876 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:38.835795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:38.835795 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:38.956810 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:36:38.964453 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3c22586b-4e62-4843-958a-1d7333e623d5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1454 microversion: 2.1 time: 0.147916 Sep 23 03:36:38.965030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 754/1497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:36:38 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:36:41.242054 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-d245b4f8-6ca4-4d1d-8c4f-48dcf6f5040d req-f48a20e0-f159-495e-9cd9-8771e1fc18f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8504d6a0-bcd7-4ae0-8179-ccfc733924fc", "tag": "78815846-3902-4af8-9cfb-b4b45cd307b9"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:36:41.243532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:36:41.243532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:36:41.250738 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d245b4f8-6ca4-4d1d-8c4f-48dcf6f5040d req-f48a20e0-f159-495e-9cd9-8771e1fc18f0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:36:41.251174 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-d245b4f8-6ca4-4d1d-8c4f-48dcf6f5040d req-f48a20e0-f159-495e-9cd9-8771e1fc18f0 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:36:41.262414 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-d245b4f8-6ca4-4d1d-8c4f-48dcf6f5040d req-f48a20e0-f159-495e-9cd9-8771e1fc18f0 service nova] Creating event network-changed:78815846-3902-4af8-9cfb-b4b45cd307b9 for instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc on hv-cinder-76845 Sep 23 03:36:41.267468 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-d245b4f8-6ca4-4d1d-8c4f-48dcf6f5040d req-f48a20e0-f159-495e-9cd9-8771e1fc18f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084367 Sep 23 03:36:41.272718 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 744/1498] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:36:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:38:00.125137 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:38:00.125819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:38:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:38:04.437118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:38:04.437613 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:38:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:38:37.749779 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:38:37.750368 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:38:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:38:54.892671 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:54.893206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:54.898941 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:54.899378 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:54.900843 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:54.901271 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:54.925342 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:38:55.185907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3c95f8a9-320f-4b56-832c-53c1c8129db7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 204 len: 0 microversion: 2.1 time: 0.297593 Sep 23 03:38:55.186487 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 755/1499] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:38:54 2021] DELETE /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:38:55.195953 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:55.197216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:55.203855 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:55.205597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:55.205597 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:55.205954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:55.404432 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:55.414955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3fdba3fd-5def-4ca3-9ad7-334761fcb7f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1579 microversion: 2.1 time: 0.220885 Sep 23 03:38:55.414955 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 745/1500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:38:55 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1579 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:56.429374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:56.430086 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:56.436543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:56.436991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:56.437745 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:56.438169 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:56.610923 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:56.619258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-d8538a4b-15a5-4455-8a75-d3a4c250c826 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1579 microversion: 2.1 time: 0.194015 Sep 23 03:38:56.619807 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 756/1501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:38:56 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:57.635710 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:57.636311 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:57.642375 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:57.642819 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:57.643591 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:57.644034 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:57.749649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:57.749649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-de2c89de-5c83-4a54-b38a-3d5255abab7f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1511 microversion: 2.1 time: 0.088063 Sep 23 03:38:57.749649 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 746/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:38:57 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:57.961545 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1de1f3fa-23b6-4734-9114-d7d882806429 req-95c9a64c-f348-4b6a-96bd-7ed42dea1e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8504d6a0-bcd7-4ae0-8179-ccfc733924fc", "name": "network-vif-deleted", "tag": "78815846-3902-4af8-9cfb-b4b45cd307b9"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:38:57.963805 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:38:57.963805 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:38:57.970933 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1de1f3fa-23b6-4734-9114-d7d882806429 req-95c9a64c-f348-4b6a-96bd-7ed42dea1e00 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:57.971374 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1de1f3fa-23b6-4734-9114-d7d882806429 req-95c9a64c-f348-4b6a-96bd-7ed42dea1e00 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:57.983258 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1de1f3fa-23b6-4734-9114-d7d882806429 req-95c9a64c-f348-4b6a-96bd-7ed42dea1e00 service nova] Creating event network-vif-deleted:78815846-3902-4af8-9cfb-b4b45cd307b9 for instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc on hv-cinder-76845 Sep 23 03:38:57.988242 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1de1f3fa-23b6-4734-9114-d7d882806429 req-95c9a64c-f348-4b6a-96bd-7ed42dea1e00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030407 Sep 23 03:38:57.989164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 757/1503] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:38:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:38:58.736347 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:58.736982 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:58.744202 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:58.744340 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:58.745108 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:58.745538 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:58.776665 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:58.777157 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:58.777593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lazy-loading 'fault' on Instance uuid 8504d6a0-bcd7-4ae0-8179-ccfc733924fc {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:38:58.821765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:38:58.829149 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-fbfc7d8e-4723-4ab0-8642-23cc87fa4154 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 200 len: 1230 microversion: 2.1 time: 0.096491 Sep 23 03:38:58.830669 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 747/1504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:38:58 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:38:59.851046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:38:59.851744 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:38:59.857808 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:59.858243 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:59.858991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:38:59.859411 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:38:59.872557 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] HTTP exception thrown: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. Sep 23 03:38:59.873124 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Returning 404 to user: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:38:59.873940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-aa6eff9b-3f65-4d40-8bd0-cf836c529be3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 404 len: 111 microversion: 2.1 time: 0.026965 Sep 23 03:38:59.874439 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 758/1505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:38:59 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:38:59.919203 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1713751756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1478765032", "security_groups": [{"name": "tempest-secgroup-smoke-1454802404"}], "block_device_mapping_v2": [{"uuid": "b9520b96-2ca5-49a0-9e62-5f196bc8fe00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96d4f41a-803c-46c5-8381-2a138296e8f6"}]}} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:00.020437 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.network.neutron [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] validate_networks() for [('96d4f41a-803c-46c5-8381-2a138296e8f6', None, None, None, None, None)] {{(pid=108954) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:39:00.427717 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:39:00.428136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image limits 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:39:00.428641 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:39:00.429048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image pref 0:0:0 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:39:00.429454 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.virt.hardware [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:39:00.439236 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:00.439680 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:00.440469 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:00.440925 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:00.456746 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:39:00.460568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.quota [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for user eb1d7b6df9554a2da3ccd85d982cd8a7 and project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108954) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:39:00.518894 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Going to run 1 instances... {{(pid=108954) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:39:00.521113 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9520b96-2ca5-49a0-9e62-5f196bc8fe00',volume_size=None,volume_type=None)] {{(pid=108954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:39:00.954155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-bde666b6-aea0-4486-bea8-6fc8d89038a6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038484 Sep 23 03:39:00.954801 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 748/1506] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:38:59 2021] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:39:00.965226 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-07bd8fd5-5533-4341-8157-2009880ecf97 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:00.965886 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-07bd8fd5-5533-4341-8157-2009880ecf97 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:01.021492 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-07bd8fd5-5533-4341-8157-2009880ecf97 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:01.029246 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-07bd8fd5-5533-4341-8157-2009880ecf97 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1095 microversion: 2.1 time: 0.068336 Sep 23 03:39:01.029884 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 759/1507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:00 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:02.046420 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:02.046983 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:02.053388 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:02.053834 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:02.054593 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:02.055025 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:02.114240 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:02.122954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-ff9ba809-3323-4e9c-bbc1-b73052ee73f3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1145 microversion: 2.1 time: 0.078847 Sep 23 03:39:02.122954 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 749/1508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:02 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:39:03.137532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:03.138195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:03.144764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:03.145206 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:03.145963 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:03.146390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:03.214991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:03.222284 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-4b28f21f-f740-4a81-882a-2e1d84777d7c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1211 microversion: 2.1 time: 0.088944 Sep 23 03:39:03.222856 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 760/1509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:03 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:04.239429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:04.242015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:04.248853 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:04.249599 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:04.250589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:04.251014 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:04.383725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:04.391543 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d42f74c9-f97d-4973-b1d9-960bfd7bb4e7 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1279 microversion: 2.1 time: 0.156132 Sep 23 03:39:04.394646 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 750/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:04 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:04.496113 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-57b76d33-ae00-461b-b541-287463402efb req-bc000d78-19a8-45fd-a73c-3be7941eb121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae37ca9b-081a-4ac5-b42f-9dba1bc76708", "tag": "63f620f6-a79a-4d5c-b61e-0f5f5571d475"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:04.498539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:39:04.498539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:39:04.506523 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-57b76d33-ae00-461b-b541-287463402efb req-bc000d78-19a8-45fd-a73c-3be7941eb121 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:04.507132 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-57b76d33-ae00-461b-b541-287463402efb req-bc000d78-19a8-45fd-a73c-3be7941eb121 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:04.519051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-57b76d33-ae00-461b-b541-287463402efb req-bc000d78-19a8-45fd-a73c-3be7941eb121 service nova] Creating event network-changed:63f620f6-a79a-4d5c-b61e-0f5f5571d475 for instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 on hv-cinder-76845 Sep 23 03:39:04.550726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-57b76d33-ae00-461b-b541-287463402efb req-bc000d78-19a8-45fd-a73c-3be7941eb121 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 Sep 23 03:39:04.550726 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 761/1511] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:05.407901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:05.408532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:05.410603 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 23 03:39:05.415684 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:05.416005 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:05.416793 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:05.417231 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:05.537608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:05.545346 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-30bc6f8c-e96c-47d5-b500-bea4fb887280 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.141000 Sep 23 03:39:05.545912 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 751/1512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:05 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:06.562311 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:06.563034 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:06.568979 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:06.569423 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:06.570182 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:06.570609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:06.687176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:06.694345 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-690e34b2-8e24-42c0-9ae7-f1071b465f90 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.136042 Sep 23 03:39:06.694901 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 762/1513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:06 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:07.710860 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:07.711452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:07.728384 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:07.728851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:07.729608 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:07.730039 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:07.734859 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37264. Sep 23 03:39:07.849267 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:07.857102 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-766a60b4-00f3-4c98-90e1-c7d0ac13383f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.149885 Sep 23 03:39:07.857666 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 752/1514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:07 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:08.872515 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:08.873120 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:08.878960 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:08.879401 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:08.880154 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:08.880651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:09.002367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:09.009618 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-e10cdfa0-124c-4841-bfee-10399c632f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.140903 Sep 23 03:39:09.010176 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 763/1515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:08 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:10.026076 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:10.026686 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:10.032579 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:10.033022 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:10.033764 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:10.034188 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:10.154494 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:10.161662 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9dadf4c5-5d33-49f0-92ec-152d06a53203 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.139214 Sep 23 03:39:10.162225 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 753/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:10 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:11.179870 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:11.180450 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:11.186428 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:11.186861 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:11.187614 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:11.188040 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:11.306947 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:11.314036 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3ca6d3b4-a96d-4361-8c66-bbd14aa2a783 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.138236 Sep 23 03:39:11.314588 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 764/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:11 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:12.329790 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:12.330412 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:12.336452 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:12.336931 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:12.337698 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:12.338132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:12.458253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:12.465475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-53e3b710-00c2-40e0-9266-7e799b70bb33 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.139652 Sep 23 03:39:12.466073 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 754/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:12 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:13.481699 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:13.482309 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:13.488010 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:13.488451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:13.489239 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:13.489668 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:13.610609 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:13.618499 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-8a313643-df07-484a-917b-c198d7749df3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.139889 Sep 23 03:39:13.619065 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 765/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:13 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:14.634832 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:14.635418 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:14.641292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:14.641732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:14.642479 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:14.642906 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:14.759139 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:14.766207 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-129d7f84-eca6-434b-9a8c-70bdd4d7c1fe tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.135102 Sep 23 03:39:14.766753 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 755/1520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:14 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:15.081896 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-b346a57c-a84d-413b-9a65-11ce4112048b req-728f708d-4289-4583-a326-05234082015a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae37ca9b-081a-4ac5-b42f-9dba1bc76708", "name": "network-vif-plugged", "status": "completed", "tag": "63f620f6-a79a-4d5c-b61e-0f5f5571d475"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:15.083447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:39:15.083447 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:39:15.090693 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b346a57c-a84d-413b-9a65-11ce4112048b req-728f708d-4289-4583-a326-05234082015a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:15.091167 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b346a57c-a84d-413b-9a65-11ce4112048b req-728f708d-4289-4583-a326-05234082015a service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:15.104264 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-b346a57c-a84d-413b-9a65-11ce4112048b req-728f708d-4289-4583-a326-05234082015a service nova] Creating event network-vif-plugged:63f620f6-a79a-4d5c-b61e-0f5f5571d475 for instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 on hv-cinder-76845 Sep 23 03:39:15.109517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-b346a57c-a84d-413b-9a65-11ce4112048b req-728f708d-4289-4583-a326-05234082015a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090642 Sep 23 03:39:15.110087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 766/1521] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:39:15.782522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:15.783131 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:15.788951 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:15.789396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:15.790155 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:15.790585 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:15.907103 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:15.914328 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-0ea18c17-9095-4cd2-a2ed-c82a440875d2 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.135532 Sep 23 03:39:15.915395 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 756/1522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:15 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:16.931686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:16.932367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:16.938232 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:16.938669 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:16.939416 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:16.939839 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:17.325012 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:17.332400 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-87020fb9-d374-4250-9b0e-a6cff174f071 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1267 microversion: 2.1 time: 0.404717 Sep 23 03:39:17.332996 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 767/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:16 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:18.349286 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:18.349901 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:18.356287 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:18.356765 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:18.357530 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:18.357967 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:18.478709 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:18.486175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-feaa30f3-0be2-4c6a-be2d-06ec9c5fc31e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1454 microversion: 2.1 time: 0.140544 Sep 23 03:39:18.486748 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 757/1524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:18 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:18.502263 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:39:18.502879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:39:18.511087 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:18.511539 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:18.512316 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:18.512781 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:18.629163 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:39:18.636350 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-69a784a8-ffe7-4974-a28f-45f7b33487c5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1454 microversion: 2.1 time: 0.137902 Sep 23 03:39:18.636931 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 768/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:39:18 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:39:20.518716 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae37ca9b-081a-4ac5-b42f-9dba1bc76708", "tag": "63f620f6-a79a-4d5c-b61e-0f5f5571d475"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:39:20.520268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:39:20.520268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:39:20.527024 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:39:20.527459 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:39:20.538233 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] Creating event network-changed:63f620f6-a79a-4d5c-b61e-0f5f5571d475 for instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 on hv-cinder-76845 Sep 23 03:39:20.542253 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] [1743bbb0-0e4b-410f-9c1f-d571b28a67f2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:39:21.559000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] [1743bbb0-0e4b-410f-9c1f-d571b28a67f2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37298. Sep 23 03:39:21.562229 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-fe9942d1-aafc-43f4-b0a9-4866dd78c2c9 req-9b14e324-e7cb-41fc-884b-514a89a196dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047319 Sep 23 03:39:21.566109 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 758/1526] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:39:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:39:37.990463 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:39:37.990940 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:39:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:41:20.820419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 03:41:20.823834 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1945319615", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1478765032", "security_groups": [{"name": "tempest-secgroup-smoke-1454802404"}], "block_device_mapping_v2": [{"uuid": "821c68df-d016-46af-b448-52b2b3ce710e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96d4f41a-803c-46c5-8381-2a138296e8f6"}]}} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:20.924851 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.network.neutron [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] validate_networks() for [('96d4f41a-803c-46c5-8381-2a138296e8f6', None, None, None, None, None)] {{(pid=108953) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 23 03:41:21.590522 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 03:41:21.590964 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image limits 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 03:41:21.591427 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Flavor pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 03:41:21.591875 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Image pref 0:0:0 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 03:41:21.592257 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.virt.hardware [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 03:41:21.600655 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:21.601093 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:21.601887 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:21.602312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:21.618326 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 23 03:41:21.622741 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.quota [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Getting quotas for user eb1d7b6df9554a2da3ccd85d982cd8a7 and project ef0ca626043a48c88655009268a6ce40. Resources: {'instances', 'ram', 'cores'} {{(pid=108953) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 23 03:41:21.680885 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Going to run 1 instances... {{(pid=108953) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 23 03:41:21.683541 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='821c68df-d016-46af-b448-52b2b3ce710e',volume_size=None,volume_type=None)] {{(pid=108953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 23 03:41:21.841118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2a8b168-9f8a-409b-bc1b-6f49dcfab3ae] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37392. Sep 23 03:41:22.090126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-aa850409-706c-40c6-9471-1ab48add2ae3 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.271463 Sep 23 03:41:22.090763 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 769/1527] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Sep 23 03:41:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 03:41:22.102314 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 03:41:22.102960 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9a849a65-58b9-43b7-a0d2-c150d95f30f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:22.104292 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9a849a65-58b9-43b7-a0d2-c150d95f30f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:22.157302 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9a849a65-58b9-43b7-a0d2-c150d95f30f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:22.163791 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9a849a65-58b9-43b7-a0d2-c150d95f30f5 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1095 microversion: 2.1 time: 0.066978 Sep 23 03:41:22.164392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 759/1528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:22 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:23.180868 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:23.181424 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:23.187892 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:23.188334 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:23.189119 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:23.189550 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:23.248792 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:23.256020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b46d1a96-3ee9-4af0-808a-bf5872befa55 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1145 microversion: 2.1 time: 0.078975 Sep 23 03:41:23.256580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 770/1529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:23 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:24.272305 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:24.272963 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:24.291275 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:24.291725 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:24.292522 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:24.292968 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:24.308238 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37416. Sep 23 03:41:24.354929 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:24.363175 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-8ba6efb0-f6a0-4b35-a9f3-edd16eed9f86 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1211 microversion: 2.1 time: 0.094621 Sep 23 03:41:24.363966 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 760/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:24 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:24.454760 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:41:24.455289 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:41:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:41:25.380581 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:25.381118 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:25.388287 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:25.388765 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:25.389580 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:25.390238 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:25.599815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:25.607407 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-1f91af9e-b352-4f06-8f34-c34235f46f38 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1279 microversion: 2.1 time: 0.230657 Sep 23 03:41:25.616743 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 771/1531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:25 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:25.737735 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-19765881-faaf-4f3d-add4-87382e224717 req-70318cf4-0324-4f63-ab60-245564c9f587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20daf501-82a7-4174-9705-774b82347dbb", "tag": "bc91f1be-61fa-44d9-a705-08b72255bdb7"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:25.739485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:41:25.739485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:41:25.746823 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-19765881-faaf-4f3d-add4-87382e224717 req-70318cf4-0324-4f63-ab60-245564c9f587 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:25.747352 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-19765881-faaf-4f3d-add4-87382e224717 req-70318cf4-0324-4f63-ab60-245564c9f587 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:25.760511 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-19765881-faaf-4f3d-add4-87382e224717 req-70318cf4-0324-4f63-ab60-245564c9f587 service nova] Creating event network-changed:bc91f1be-61fa-44d9-a705-08b72255bdb7 for instance 20daf501-82a7-4174-9705-774b82347dbb on hv-cinder-76845 Sep 23 03:41:25.764170 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-19765881-faaf-4f3d-add4-87382e224717 req-70318cf4-0324-4f63-ab60-245564c9f587 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030328 Sep 23 03:41:25.765216 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 761/1532] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:41:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:26.623907 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:26.624543 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:26.630338 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:26.630772 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:26.631526 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:26.631955 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:26.753321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:26.760470 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-125b147b-4d3f-4f8b-a16e-f201e91c3c07 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.140145 Sep 23 03:41:26.761046 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 772/1533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:26 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:27.777720 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:27.778413 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:27.784391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:27.784869 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:27.785627 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:27.786059 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:27.904421 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:27.911965 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-12143b13-b93a-4e93-a7ae-9ed7c8e4b347 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.138284 Sep 23 03:41:27.912548 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 762/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:27 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:28.928983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:28.929651 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:28.935514 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:28.935962 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:28.936748 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:28.937183 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:29.055737 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:29.063030 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-984943b3-57bb-45fd-9753-655dc035a809 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.137756 Sep 23 03:41:29.063583 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 773/1535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:28 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:30.079278 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:30.079816 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:30.085732 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:30.086178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:30.086936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:30.087367 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:30.207754 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:30.215493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-3276fc05-5fcd-4262-8982-94cc4c5a7d02 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.140251 Sep 23 03:41:30.216053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 763/1536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:30 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:31.231753 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:31.232312 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:31.238407 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:31.238845 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:31.239591 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:31.240014 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:31.357051 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:31.367278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-f569ab48-480b-488f-ab92-25d8d0c1ef3f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.136257 Sep 23 03:41:31.367278 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 774/1537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:31 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:32.381323 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:32.381936 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:32.387888 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:32.388344 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:32.389119 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:32.389553 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:32.506084 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:32.513307 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-c7932cd1-b99c-4977-9f0b-3f4f0d3aef21 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.135823 Sep 23 03:41:32.513873 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 764/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:32 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:33.531592 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:33.532237 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:33.539187 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:33.539623 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:33.540378 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:33.540832 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:33.663031 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:33.670200 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-08426cfc-44a3-4577-8cb0-ba0310c0e56f tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.143307 Sep 23 03:41:33.670756 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 775/1539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:33 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:34.686493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:34.687104 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:34.692899 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:34.693341 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:34.694092 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:34.694521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:34.811048 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:34.818667 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-6d8257f8-098f-45b9-a234-883624ff48bb tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.135766 Sep 23 03:41:34.819247 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 765/1540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:34 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:35.836369 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:35.839297 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:35.843227 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:35.843663 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:35.844410 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:35.844858 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:35.962032 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:35.970153 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-18232280-7b16-4a0f-bca6-b1004b2e95ac tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.137495 Sep 23 03:41:35.970713 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 776/1541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:35 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:36.986410 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:36.987026 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:36.993425 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:36.993866 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:36.995276 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:36.995703 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:37.116391 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:37.123589 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-80ecc1c1-7c85-4bee-8abf-f1fc15ffae39 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.140917 Sep 23 03:41:37.124148 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 766/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:36 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:37.630537 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20daf501-82a7-4174-9705-774b82347dbb", "name": "network-vif-plugged", "status": "completed", "tag": "bc91f1be-61fa-44d9-a705-08b72255bdb7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:37.632100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:41:37.632100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:41:37.639328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:37.639768 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:37.650366 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] Creating event network-vif-plugged:bc91f1be-61fa-44d9-a705-08b72255bdb7 for instance 20daf501-82a7-4174-9705-774b82347dbb on hv-cinder-76845 Sep 23 03:41:37.654386 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: ERROR oslo.messaging._drivers.impl_rabbit [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] [9b953436-b936-4b13-9e1c-0ee8e8295f82] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 03:41:38.141320 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:38.142229 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:38.148424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:38.148887 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:38.149647 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:38.150074 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:38.277321 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:38.284392 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-77efac23-8043-486f-a485-b4a5f2dab15e tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.147399 Sep 23 03:41:38.284988 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 767/1543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:38 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 03:41:38.671498 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] [9b953436-b936-4b13-9e1c-0ee8e8295f82] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37448. Sep 23 03:41:38.675100 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-1a21cb77-357a-4197-8166-d87a33492362 req-635042e7-57ce-4d6e-8849-06ba0ad72d17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.048350 Sep 23 03:41:38.676377 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 777/1544] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:41:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 03:41:39.301300 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:39.302016 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:39.308449 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:39.309121 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:39.310011 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:39.310325 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:39.428664 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:39.436475 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-34b0582f-afc4-4ffe-93b2-835fc417bad1 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.138890 Sep 23 03:41:39.437058 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 768/1545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:39 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:40.453390 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:40.454081 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:40.460221 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:40.460692 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:40.461451 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:40.461881 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:40.585349 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:40.593615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-b71d3367-bf62-42a7-8697-e9b3e474dfc6 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1267 microversion: 2.1 time: 0.144513 Sep 23 03:41:40.594166 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 778/1546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:40 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:41.609916 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:41.610502 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:41.616252 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:41.616728 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:41.617480 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:41.617914 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:41.737521 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:41.745156 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-d944f89e-0fc1-4a71-ad19-5f20d84b1779 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1454 microversion: 2.1 time: 0.138493 Sep 23 03:41:41.745751 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 769/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:41 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:41.761059 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:41:41.761672 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:41:41.767367 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:41.767815 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:41.768615 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:41.769056 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:41.885801 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:41:41.893025 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-ec917147-12c9-43b4-9149-baf2fe132332 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1454 microversion: 2.1 time: 0.136282 Sep 23 03:41:41.893624 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 779/1548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:41:41 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:41:44.129429 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-28092b06-a0e4-45ba-8082-850d15db1d51 req-083e5832-5761-44ba-8974-b0b961dd103b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20daf501-82a7-4174-9705-774b82347dbb", "tag": "bc91f1be-61fa-44d9-a705-08b72255bdb7"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:41:44.131077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:41:44.131077 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:41:44.138000 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-28092b06-a0e4-45ba-8082-850d15db1d51 req-083e5832-5761-44ba-8974-b0b961dd103b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:41:44.139532 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-28092b06-a0e4-45ba-8082-850d15db1d51 req-083e5832-5761-44ba-8974-b0b961dd103b service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:41:44.149041 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-28092b06-a0e4-45ba-8082-850d15db1d51 req-083e5832-5761-44ba-8974-b0b961dd103b service nova] Creating event network-changed:bc91f1be-61fa-44d9-a705-08b72255bdb7 for instance 20daf501-82a7-4174-9705-774b82347dbb on hv-cinder-76845 Sep 23 03:41:44.154529 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-28092b06-a0e4-45ba-8082-850d15db1d51 req-083e5832-5761-44ba-8974-b0b961dd103b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079982 Sep 23 03:41:44.155108 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 770/1549] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:41:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:41:57.767833 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:41:57.768568 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:41:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:43:46.974117 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:46.974654 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:46.980096 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 03:43:46.984027 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [req-e3d50c20-0be1-4326-8ade-78921350fe27 req-41cad389-ddc1-450a-9acb-ba00bf5fb5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20daf501-82a7-4174-9705-774b82347dbb", "tag": "bc91f1be-61fa-44d9-a705-08b72255bdb7"}]} {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:46.985493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:43:46.985493 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: warnings.warn(msg) Sep 23 03:43:46.991840 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:46.992291 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:46.992540 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-e3d50c20-0be1-4326-8ade-78921350fe27 req-41cad389-ddc1-450a-9acb-ba00bf5fb5b7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:46.993091 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [req-e3d50c20-0be1-4326-8ade-78921350fe27 req-41cad389-ddc1-450a-9acb-ba00bf5fb5b7 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:46.993217 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:46.993552 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:47.004071 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.compute.server_external_events [req-e3d50c20-0be1-4326-8ade-78921350fe27 req-41cad389-ddc1-450a-9acb-ba00bf5fb5b7 service nova] Creating event network-changed:bc91f1be-61fa-44d9-a705-08b72255bdb7 for instance 20daf501-82a7-4174-9705-774b82347dbb on hv-cinder-76845 Sep 23 03:43:47.010259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [req-e3d50c20-0be1-4326-8ade-78921350fe27 req-41cad389-ddc1-450a-9acb-ba00bf5fb5b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 Sep 23 03:43:47.011043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 771/1550] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:47.020686 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Going to try to terminate instance {{(pid=108953) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:43:47.298235 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-c01fc98e-bf79-4cc5-8095-3c3fa25c47ae tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 204 len: 0 microversion: 2.1 time: 0.328556 Sep 23 03:43:47.298823 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 780/1551] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:43:46 2021] DELETE /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:47.308106 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:47.309554 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:47.315994 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:47.316715 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:47.317679 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:47.318317 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:47.449178 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:47.457453 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-4f47a7a1-a829-4c89-8b83-f0e29689574b tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1579 microversion: 2.1 time: 0.153996 Sep 23 03:43:47.458584 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 772/1552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:47 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:48.475465 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:48.476164 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:48.482560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:48.483007 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:48.483770 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:48.484203 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:48.605819 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:48.613083 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3573fd76-d30a-46db-b7ea-8a65dced5a13 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1460 microversion: 2.1 time: 0.141691 Sep 23 03:43:48.613649 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 781/1553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:48 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1460 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:49.629500 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:49.630046 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:49.646786 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:49.647232 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:49.648002 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:49.648433 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:49.654273 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e32423-bb52-405a-bdcb-b2a87fc142bb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37524. Sep 23 03:43:49.771516 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:49.778809 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-85cd5779-d0c3-496b-a9e8-994760a1af8a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1460 microversion: 2.1 time: 0.153050 Sep 23 03:43:49.779385 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 773/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:49 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:49.866633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-b860ea4a-c6d8-4953-b385-d26d0a30a138 req-6bd66eac-5fd2-4e6d-aec1-5777926fba45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20daf501-82a7-4174-9705-774b82347dbb", "name": "network-vif-deleted", "tag": "bc91f1be-61fa-44d9-a705-08b72255bdb7"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:49.866633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:43:49.866633 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:43:49.872827 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b860ea4a-c6d8-4953-b385-d26d0a30a138 req-6bd66eac-5fd2-4e6d-aec1-5777926fba45 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:49.873195 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-b860ea4a-c6d8-4953-b385-d26d0a30a138 req-6bd66eac-5fd2-4e6d-aec1-5777926fba45 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:49.884039 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-b860ea4a-c6d8-4953-b385-d26d0a30a138 req-6bd66eac-5fd2-4e6d-aec1-5777926fba45 service nova] Creating event network-vif-deleted:bc91f1be-61fa-44d9-a705-08b72255bdb7 for instance 20daf501-82a7-4174-9705-774b82347dbb on hv-cinder-76845 Sep 23 03:43:49.889138 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-b860ea4a-c6d8-4953-b385-d26d0a30a138 req-6bd66eac-5fd2-4e6d-aec1-5777926fba45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028772 Sep 23 03:43:49.899389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 782/1555] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:43:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:50.795333 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:50.795937 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:50.801683 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:50.802123 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:50.802871 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:50.803295 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:50.833640 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:50.834083 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:50.834525 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.objects.instance [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lazy-loading 'fault' on Instance uuid 20daf501-82a7-4174-9705-774b82347dbb {{(pid=108954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 23 03:43:50.873285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:50.880444 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-5f1801be-74be-4ef8-96ed-92a2f7e74e2c tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 200 len: 1231 microversion: 2.1 time: 0.088831 Sep 23 03:43:50.881043 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 774/1556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:50 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 1231 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:51.904701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:51.905419 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 20daf501-82a7-4174-9705-774b82347dbb] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:51.911560 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:51.911991 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:51.912764 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:51.913186 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:51.925983 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] HTTP exception thrown: Instance 20daf501-82a7-4174-9705-774b82347dbb could not be found. Sep 23 03:43:51.926542 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Returning 404 to user: Instance 20daf501-82a7-4174-9705-774b82347dbb could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:43:51.927330 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-15f91c55-ad0f-444b-8ab3-273f3097a4ce tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb" status: 404 len: 111 microversion: 2.1 time: 0.026700 Sep 23 03:43:51.927841 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 783/1557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:51 2021] GET /compute/v2.1/servers/20daf501-82a7-4174-9705-774b82347dbb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:43:55.544402 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.544935 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:55.550946 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:55.551401 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:55.552104 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-bb6474e9-3c69-43b0-9455-07079c2be729 req-d5269f0c-3d21-4689-928c-85a226ad7793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae37ca9b-081a-4ac5-b42f-9dba1bc76708", "tag": "63f620f6-a79a-4d5c-b61e-0f5f5571d475"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:55.552558 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:55.552744 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:55.553754 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:43:55.553754 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:43:55.561274 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-bb6474e9-3c69-43b0-9455-07079c2be729 req-d5269f0c-3d21-4689-928c-85a226ad7793 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:55.561715 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-bb6474e9-3c69-43b0-9455-07079c2be729 req-d5269f0c-3d21-4689-928c-85a226ad7793 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:55.573911 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-bb6474e9-3c69-43b0-9455-07079c2be729 req-d5269f0c-3d21-4689-928c-85a226ad7793 service nova] Creating event network-changed:63f620f6-a79a-4d5c-b61e-0f5f5571d475 for instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 on hv-cinder-76845 Sep 23 03:43:55.579222 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-bb6474e9-3c69-43b0-9455-07079c2be729 req-d5269f0c-3d21-4689-928c-85a226ad7793 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Sep 23 03:43:55.579396 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Going to try to terminate instance {{(pid=108954) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 23 03:43:55.579812 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 784/1558] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:43:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:55.880424 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-eb4ebeff-9f46-43dc-bba0-00340a602d40 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 204 len: 0 microversion: 2.1 time: 0.339594 Sep 23 03:43:55.889053 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 775/1559] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:43:55 2021] DELETE /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 03:43:55.890816 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:55.892306 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:55.898879 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:55.899328 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:55.900171 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:55.900694 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:56.173602 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.policy [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108953) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:56.182321 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-da214471-aafd-420b-b685-353aac398200 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1579 microversion: 2.1 time: 0.296290 Sep 23 03:43:56.183585 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 785/1560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:55 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1579 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:57.201136 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:57.201825 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:57.207639 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:57.210570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:57.210570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:57.210570 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:57.384895 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:57.392154 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-90af965b-8aed-4d24-9190-60e5db60aeaa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1460 microversion: 2.1 time: 0.195275 Sep 23 03:43:57.392938 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 776/1561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:57 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1460 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:58.185092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [req-d822130b-a950-4236-a65c-5e153e4b0ae0 req-e00527f9-d908-4bc4-bd24-09ba097dfbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae37ca9b-081a-4ac5-b42f-9dba1bc76708", "name": "network-vif-deleted", "tag": "63f620f6-a79a-4d5c-b61e-0f5f5571d475"}]} {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 03:43:58.186603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 03:43:58.186603 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: warnings.warn(msg) Sep 23 03:43:58.193251 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d822130b-a950-4236-a65c-5e153e4b0ae0 req-e00527f9-d908-4bc4-bd24-09ba097dfbe2 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:58.197701 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [req-d822130b-a950-4236-a65c-5e153e4b0ae0 req-e00527f9-d908-4bc4-bd24-09ba097dfbe2 service nova] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:58.204993 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.compute.server_external_events [req-d822130b-a950-4236-a65c-5e153e4b0ae0 req-e00527f9-d908-4bc4-bd24-09ba097dfbe2 service nova] Creating event network-vif-deleted:63f620f6-a79a-4d5c-b61e-0f5f5571d475 for instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 on hv-cinder-76845 Sep 23 03:43:58.210215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [req-d822130b-a950-4236-a65c-5e153e4b0ae0 req-e00527f9-d908-4bc4-bd24-09ba097dfbe2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028874 Sep 23 03:43:58.210785 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 786/1562] 10.222.0.23 () {64 vars in 1318 bytes} [Thu Sep 23 03:43:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 03:43:58.408549 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:58.409088 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:58.415511 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:58.421132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:58.421132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:58.421132 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:58.475851 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.policy [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1d7b6df9554a2da3ccd85d982cd8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0ca626043a48c88655009268a6ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108954) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 03:43:58.484268 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-9718c1cf-a513-4510-8f42-b705ea5bf68a tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 200 len: 1226 microversion: 2.1 time: 0.079376 Sep 23 03:43:58.484890 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 777/1563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:58 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 03:43:59.501281 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:43:59.501895 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: ae37ca9b-081a-4ac5-b42f-9dba1bc76708] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:43:59.508045 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:59.508503 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:59.509266 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:43:59.509696 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:43:59.522517 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] HTTP exception thrown: Instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 could not be found. Sep 23 03:43:59.523094 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Returning 404 to user: Instance ae37ca9b-081a-4ac5-b42f-9dba1bc76708 could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:43:59.523903 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-3fef41fc-96b5-4a9e-9681-f94126b89900 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708" status: 404 len: 111 microversion: 2.1 time: 0.026814 Sep 23 03:43:59.524418 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 787/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:43:59 2021] GET /compute/v2.1/servers/ae37ca9b-081a-4ac5-b42f-9dba1bc76708 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:00.061015 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:00.061519 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.compute.api [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108954) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:44:00.067285 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:44:00.067731 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:44:00.068517 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:44:00.068942 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG oslo_concurrency.lockutils [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:44:00.082179 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.wsgi [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] HTTP exception thrown: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. Sep 23 03:44:00.082694 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Returning 404 to user: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. {{(pid=108954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:44:00.083498 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-006ecc99-c9c9-4e2f-a2e8-4f2676fb5e72 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 404 len: 111 microversion: 2.1 time: 0.026258 Sep 23 03:44:00.084004 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 778/1565] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Sep 23 03:44:00 2021] DELETE /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:00.092347 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '>' {{(pid=108953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:00.093020 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.compute.api [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] [instance: 8504d6a0-bcd7-4ae0-8179-ccfc733924fc] Fetching instance by UUID {{(pid=108953) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 23 03:44:00.098723 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:44:00.099161 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:44:00.099921 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 23 03:44:00.100352 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG oslo_concurrency.lockutils [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Lock "d2e928b7-7406-4a56-84c2-2a89dd3469c1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 23 03:44:00.114092 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.wsgi [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] HTTP exception thrown: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. Sep 23 03:44:00.114676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: DEBUG nova.api.openstack.wsgi [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Returning 404 to user: Instance 8504d6a0-bcd7-4ae0-8179-ccfc733924fc could not be found. {{(pid=108953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 23 03:44:00.115497 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO nova.api.openstack.requestlog [None req-0ed0e353-5adb-43bd-b91f-e1bf3823d9aa tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc" status: 404 len: 111 microversion: 2.1 time: 0.026916 Sep 23 03:44:00.116021 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: [pid: 108953|app: 0|req: 788/1566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Sep 23 03:44:00 2021] GET /compute/v2.1/servers/8504d6a0-bcd7-4ae0-8179-ccfc733924fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 03:44:01.650100 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: DEBUG nova.api.openstack.wsgi [None req-b4876df3-d732-4e29-80cc-b62b99f7e251 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] Calling method '.version_select at 0x7fd1b4119a60>' {{(pid=108954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 03:44:01.709485 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO nova.api.openstack.requestlog [None req-b4876df3-d732-4e29-80cc-b62b99f7e251 tempest-TestVolumeBootPattern-1466899214 tempest-TestVolumeBootPattern-1466899214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1478765032" status: 202 len: 0 microversion: 2.1 time: 0.063147 Sep 23 03:44:01.710062 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: [pid: 108954|app: 0|req: 779/1567] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Sep 23 03:44:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1478765032 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 03:44:38.010532 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:44:38.011126 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:44:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:44:40.146198 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:44:40.146692 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:44:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:44:44.478452 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:44:44.479018 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:44:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:46:37.899446 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:46:37.899970 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:46:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:46:38.680803 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:46:38.681384 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:46:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:46:57.787259 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:46:57.787776 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:46:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:47:58.029389 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:47:58.029926 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:47:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:48:00.166882 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:48:00.167356 dv-cinder-768458-9-iscsi devstack@n-api.service[108954]: Thu Sep 23 03:48:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 23 03:48:04.497215 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 03:48:04.497676 dv-cinder-768458-9-iscsi devstack@n-api.service[108953]: Thu Sep 23 03:48:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!